NAVAL  POSTGRADUATE  SCHOOL 

Monterey,  California 


THESIS 


THE  EFFECT  OF  TASK  COMPLEXITY 
ON  USER  INTERFACES:  A  COMPARISON 
OF  COMMAND  LANGUAGE  INTERFACE 
AND  DIRECT  MANIPULATION  INTERFACE 

by 

Nancy  A.  Reinhard 

-MARCH  19Q1 

Thesis  Advisor:  Kishore  Sengupta 


Approved  for  public  release;  distribution  is  unlimited 

T2547U 


Unclassified 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 


REPORT  DOCUMENTATION  PAGE 


la.  REPORT  SECURITY  CLASSIFICATION 
Unclassified 


lb.  RESTRICT VE  MARKINGS 


2a.  SECURITY  CLASSIFICATION  AUTHORITY 


2b.  DECLASSIFICATION/DOWNGRADING  SCHEDULE 


3.  DISTRIBUTION/AVAILABILITY  OF  REPORT 
Approved  for  public  release;  distribution  is  unlimited. 


4.  PERFORMING  ORGANIZATION  REPORT  NUMBERfS) 


5.  MONITORING  ORGANIZATION  REPORT  NUMBERfS) 


6a.  NAME  OF  PERFORMING  ORGANIZATION 
Naval  Postgraduate  School 


6b.  OFFICE  SYMBOL 
(tf  applicable) 

AS 


7a.  NAME  OF  MONITORING  ORGANIZATION 
Naval  Postgraduate  School 


6c.  ADDRESS  {City,  State,  and  ZIP  Code) 
Monterey,  C A  93943-5000 


7b.  ADDRESS  (City,  State,  and  ZIP  Code) 
Monterey.  CA  93943-5000 


8a-  NAME  OF  FUNDING/SPONSORING 
ORGANIZATION 


8b.  OFFICE  SYMBOL 
(If  applicable) 


9.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 


8c.  ADDRESS  (City,  State,  and  ZIP  Code) 


10.  SOURCE  OF  FUNDING  NUMBERS 


Program  Element  No 


Project  No 


Task  NO. 


Work  Unit  Accession 
Number 


1 1 .  TITLE  (Include  Security  Classification) 

The  Effect  of  Task  Complexity  on  User  Interfaces:  A  Comparison  of  Command  Language  Interface  and  Direct  Manipulation  Interface 


12.  PERSONAL  AUTHOR(S)  Reinhard,  Nancy  A. 


13a.  TYPE  OF  REPORT 

13b.  TIME  COVERED 

14.  DATE  OF  REPORT  (year,  month,  day) 

15  PAGE  COUNT 

Master’s  Thesis 

From  To 

March  1991 

^  /55 

16.  SUPPLEMENTARY  NOTATION 

The  views  expressed  in  this  thesis  are  those  of  the  author  and  do  not  reflect  the  official  policy  or  position  of  the  Department  of  Defense  or  the  U.S. 
Government. 


17.COSATI  CODES 

FIELD 

GROUP 

SUBGROUP 

1 8.  SUBJECT  TERMS  (continue  on  reverse  if  necessary  and  identify  by  block  number) 

User-Interface;  Human-Computer  Interaction;  Task  Complexity;  Direct  Manipulation 
Interface;  Command  Language  Interface 


1 9  ABSTRACT  (continue  on  reverse  if  necessary  and  identify  by  block  number) 

A  computer-user  interface  is  the  software  that  communicates  the  user’s  inputs  to  the  computer  and  returns  information  from  the  computer  back 
to  the  user.  A  variety  of  user  interfaces  have  been  developed,  including  command  language  interfaces,  direct  manipulation  interfaces,  and  menus. 
This  research  explored  the  relative  benefits  of  command  language  interfaces  (CLl )  and  direct  manipulation  interfaces  (DM1)  for  performance  of 
simple  and  complex  tasks  by  novices.  Two  levels  of  task  complexity  were  used,  one  requiring  five  inputs  (simple)  and  one  requiring  24  inputs 
(complex).  Dependent  variables  were  ( 1 )  time  to  complete  each  task  set.  (2)  number  of  errors,  and  (3)  number  of  references  to  on-line  help.  Results 
indicate  that  learning  to  use  a  DMI  takes  longer  than  learning  to  use  a  CLl.  No  significant  difference  was  observed  in  time  to  complete  the  simple 
task.  However,  once  a  novice  learns  to  use  a  DMI,  a  complex  task  requires  less  time,  fewer  errors  are  made,  and  references  to  help  screens  are 
required  less  often.  With  complex  tasks,  direct  manipulation  interfaces  appear  to  help  novices  to  be  more  productive  than  do  command  language 
interfaces. 


20.  DISTRIBUTION/AVAILABILITY  OF  ABSTRACT 
171  UNCLASSIFIED/UNLIMITED  FI  SAME  AS  REPORT  ^  DTIC  USERS 


22d.  NAME  OF  RESPONSIBLE  INDIVIDUAL 
Sengupta.  Kishore _ 


2 1 .  ABSTRACT  SECURITY  CLASSIFICATION 
Unclassified 


22b.  TELEPHONE  (Include  Area  code) 
(408)646-3212 


22c.  OFFICE  SYMBOL 
Code  AS/SE 


DD  FORM  1473, 84  MAR 


83  APR  edition  may  be  used  until  exhausted 
All  other  editions  are  obsolete 


SECURITY  CLASSIFICATION  OF  THIS  PAGE 

Unclassified 


1 


Approved  for  public  release;  distribution  is  unlimited. 


The  Effect  of  Task  Complexity  on  User  Interfaces: 
A  Comparison  of  Command  Language  Interface 
and  Direct  Manipulation  Interface 

by 

Nancy  A.^Reinheird 

Lieutenant,  United  States  Navy,  Reserve 
B.S.,  Wright  State  University  ,  1 983 

Submitted  in  partial  fulfillment 
of  the  requirements  for  the  degree  of 

MASTER  OF  SCIENCE  IN  (Information  Systems) 


from  the 


ABSTRACT 


A  computer-user  interface  is  the  software  that  communicates  the  user’s 
inputs  to  the  computer  and  returns  information  from  the  computer  back  to  the 
user.  A  variety  of  user  interfaces  have  been  developed,  including  command 
language  interfaces,  direct  manipulation  interfaces,  and  menus.  This  research 
explored  the  relative  beneHts  of  command  language  interfaces  (CLI)  and  direct 
manipulation  interfaces  (DMI)  for  performance  of  simple  and  complex  tasks  by 
novices.  Two  levels  of  task  complexity  were  used,  one  requiring  five  inputs 
(simple)  and  one  requiring  24  inputs  (complex).  Dependent  variables  were  (1)  time 
to  complete  each  task  set,  (2)  number  of  errors,  and  (3)  number  of  references  to  on¬ 
line  help.  Results  indicate  that  learning  to  use  a  DMI  takes  longer  than  learning  to 
use  a  CLI.  No  significant  difference  was  observed  in  time  to  complete  the  simple 
task.  However,  once  a  novice  learns  to  use  a  DMI,  a  complex  task  requires  less 
time,  fewer  errors  are  made,  and  references  to  help  screens  are  required  less  often. 
With  complex  tasks,  direct  manipulation  interfaces  appear  to  help  novices  to  be 
more  productive  than  do  command  language  interfaces. 


Ill 


/  Asi 

'Ad20  2'i 

t'l 

TABLE  OF  CONTENTS 

I.  INTRODUCTION  .  1 

A.  BACKGROUND .  1 

1 .  User  Interfaces  and  Complexity .  1 

2 .  Task  Complexity .  3 

3 .  Command  Language  and  Direct  Manipulation 

Interfaces  .  4 

B.  GOAL  AND  SCOPE .  7 

II.  COMPLEXITY  AND  USER  INTERFACES .  8 

A.  USER  INTERFACE .  8 

1 .  Perceptual  System  .  9 

2 .  Cognitive  System  .  9 

3.  Motor  System .  10 

B.  INTERFACE  COMPLEXITY  .  11 

1.  Definition  of  Complexity .  11 

a.  Task  Complexity .  11 

b.  User  Interface  Complexity .  12 

2 .  Task  and  Device  Representations  ....  12 

3.  Predicting  Ease  of  Learning  and  Use  .  .  14 

C.  TASK  COMPLEXITY .  16 

1 .  Task  Complexity  Components .  17 

2.  Types  of  Task  Complexity .  18 

D.  USER  INTERFACES .  19 

1.  Command  Language  Interfaces  .  20 

2.  Direct  Manipulation  Interface  .  21 

E.  SUMMARY .  23 

III.  METHODOLOGY .  24 

A.  EXPERIMENTAL  DESIGN  .  24 

1.  Independent  VariaOsles .  24 

2 .  Dependent  Variables .  25 

B.  HYPOTHESES .  27 

C.  SUBJECTS .  28 

D.  APPARATUS .  28 

E.  TASKS .  29 

F.  COMMAND  LANGUAGE  INTERFACE  .  30 

1.  Practice  Session  Screens  .  35 

2.  Screens  Used  for  the  Simple  Task  Set  .  .  35 

3.  Screens  Used  for  the  Complex  Task  Set  .  38 

G.  DIRECT  MANIPULATION  INTERFACE .  39 

1.  Practice  Session  Screens  .  47 

2.  Screens  Used  for  the  Simple  Task  Set  .  .  47 

3.  Screens  Used  for  the  Complex  Task  Set  .  49 

H.  EXPERIMENTAL  PROCEDURE .  50 

1.  Training  and  Practice  Session  .  51 

2.  Data  Collection  Sessions .  52 

3.  Post-Test  Data  Collection .  53 

I.  DATA  COLLECTION  PROCEDURE .  54 

iv 


IV.  RESULTS .  56 

A.  DATA  ANALYSIS .  56 

B.  EXPERIMENTAL  RESULTS  .  56 

1 .  Task  Completion  Time .  61 

2 .  Nvimber  of  Errors .  63 

3 .  Help  References .  65 

C.  SUBJECT  RESPONSES  .  68 

D.  PROCESS  AND  MANIPULATION  CHECKS .  70 

V.  CONCLUSIONS  AND  RECOMMENDATIONS  .  73 

A.  GOAL .  73 

B.  HYPOTHESES .  73 

C.  CONCLUSIONS  OF  STUDY .  74 

D.  LIMITATIONS  AND  FURTHER  RESEARCH .  75 

APPENDIX  A  -  DEFINITIONS .  77 

APPENDIX  B  -  COMMAND  LANGUAGE  INTERFACE  .  80 

APPENDIX  C  -  SUMMARY  OF  INTERFACE  COMMANDS  .  97 

APPENDIX  D  -  DIRECT  MANIPULATION  INTERFACE  .  99 

APPENDIX  E  -  EXAMPLE  OF  CLI  USER  LOG . 121 

APPENDIX  F  -  EXAMPLE  OF  DMI  USER  LOG . 122 

APPENDIX  G  -  CODES  AND  MESSAGES  FOR  CLI  . 123 

APPENDIX  H  -  CODES  AND  MESSAGES  FOR  DMI . 125 

REFERENCES . 126 

INITIAL  DISTRIBUTION  LIST  .  128 


V 


I.  INTRODUCTION 

A.  BACKGROUND 

I.  User  IntBrfscBS  and  CoxaplBxxty 

User  interface  is  described  as  the  dialogue  that  occurs 
between  a  user  and  a  computer  in  order  to  accomplish  a 
specific  task.  The  computer  interface  includes  all  of  the 
hardware  and  software  needed  to  support  the  dialogue.  The 
htunan  or  user  interface  also  includes  the  individual's 
knowledge  and  understanding  of  the  system,  perception  of  the 
system,  and  motor  caped:>ilities.  These  three  factors  strongly 
influence  the  user's  cibility  to  operate  the  computer 
satisfactorily.  [Ref  l:pp.  23-24] 

Card  and  others  describe  the  design  of  a  hvunan-computer 
interface  in  terms  of  three  types  of  mental  processing 
systems:  perceptual,  cognitive,  and  motor.  They  suggest  that 
the  designer  of  an  interface  can  change  the  overall  level  of 
difficulty  of  an  interface  by  adjusting  input  and  output 
difficulty  related  to  the  various  types  of  processing. 

[Ref  l;p.  24] 

Card  and  his  colleagues  use  what  is  referred  to  as  the 
GOMS  model  to  describe  and  predict  human  behavior  (see 
Appendix  A  for  definitions) .  The  GOMS  model  describes  the 
user's  cognitive  structure  as  consisting  of  four  components: 
(1)  a  set  of  Goals,  (2)  a  set  of  Operators,  (3)  a  set  of 
Methods  for  achieving  the  goals,  and  (4)  a  set  of  Selection 
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rules  for  choosing  among  competing  methods  for  goals.  [Ref 
l:pp.  139-144] 

As  described  by  Card  and  others,  a  goal  is  a  symbolic 
structure  that  defines  a  state  of  affairs  to  be  achieved  and 
determines  a  set  of  possible  methods  by  which  it  can  be 
accomplished.  Operators  are  elementary  perceptual,  motor,  or 
cognitive  acts  whose  execution  is  necessary  to  change  any 
aspect  of  the  user' s  mental  state  or  affect  the  task 
environment.  Methods  describe  procedures  for  accomplishing  a 
goal.  Selection  rules  are  used  to  determine  which  method 
should  be  used  to  satisfy  a  given  goal  or  subgoal  in  a 
specified  context.  [Ref  l:pp.  144-146] 

Complexity  is  defined  by  Rasmussen  as  the  number  of  goals 
and  processes  that  must  be  controlled  by  an  operator  or  user 
of  a  system.  The  characteristics  of  the  means  availcible  for 
this  control  also  determine  complexity.  [Ref  2;p.  24] . 

User  interface  complexity  is  the  complexity  of  the  entire 
interface  system  from  a  user's  point  of  view.  Interface 
complexity  relates  to  the  user' s  knowledge  of  the  given  system 
or  similar  systems,  and  to  the  task  itself.  If  the  user 
perceives  the  interface  and/or  the  task  to  be  complex,  the 
user  will  have  difficulty  completing  the  task  successfully. 
[Ref  3:p.  365] 

Kieras  and  Poison  expanded  the  GOMS  model  to  develop  a 
new  model,  the  Production  model,  that  includes  production 
rules  and  can  be  used  to  predict  ease  of  learning  and  using  a 
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system  as  a  function  of  complexity.  A  production  rule  is  a 
condition-action  pair  of  the  form: 

IF  (condition)  THEN  (action) . 

When  a  system  requires  the  use  of  many  productions  rules,  it 
is  complex  and  will  be  difficult  to  learn.  The  Kieras  and 
Poison  work  is  known  as  the  Cognitive  Complexity  approach. 
[Ref  3:p.  1] 

Bovair  and  others  have  conducted  further  research  based 
on  the  Cognitive  Complexity  approach  to  describe  principles 
for  constructing  Production  models.  Their  work  has  provided 
support  for  the  hypothesis  that  production  rule  models  Cem  be 
used  to  make  quantitative  predictions  related  both  to  ease  of 
learning  and  to  ease  of  use.  [Ref  4:p.  1] 

2.  TasJc  ComplBxity 

Wood  defines  task  complexity  in  terms  of  information 
processing  and  decision  making  [Ref  5:p.  40].  According  to 
Wood,  task  complexity  is  the  measurable  complexity  of  the  task 
that  is  being  performed.  If  task  inputs  and  outputs  are 
known,  the  total  task  complexity  can  be  calculated.  The 
inputs  for  a  task  include  the  acts  required  to  carry  out  the 
task  and  the  information  cues  aibout  the  task  that  the  user  has 
available.  These  inputs  are  processed  to  form  a  product, 
which  is  the  output.  [Ref  6:pp.  66-74] 

Wood  identifies  the  components  of  a  task  as  products, 
required  acts,  and  information  cues.  These  components  are 
used  to  define  three  forms  of  task  complexity,  referred  to  as 
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component,  coordinative,  and  dynamic.  Component  complexity 
results  from  the  combination  of  the  required  acts  and  the 
information  cues.  Coordinative  complexity  is  due  to  the 
inputs  (required  acts  and  information  cues)  as  the  function  of 
the  products.  Dynamic  complexity  is  the  result  of  changes  in 
the  states  of  the  world  which  affect  the  relationships  between 
task  inputs  and  products.  [Ref  6;pp.  64-74] 

Wood  proposes  that  variations  in  task  complexity  produce 
changes  in  knowledge,  skill,  and  effort  requirements  for 
successful  task  performance.  Additionally,  task  performance 
depends  on  the  combination  of  component,  coordinative,  and 
dynamic  complexity.  [Ref  6:p.  79] 

3.  Command  Languaga  and  Dxract  Manipulation 

Interfaces 

Command  language  (CL)  interfaces  are  the  traditional, 
most  common  computer  interfaces.  With  these  systems,  the  user 
communicates  with  the  computer  by  typing  commands,  each  of 
which  has  a  specific  syntax.  These  interfaces  generally 
require  the  user  to  memorize  the  command  syntax  and  the  order 
of  the  commands  for  successful  communication  with  the 
computer.  As  a  result,  CL  interfaces  usually  are  considered 
to  have  high  user  interface  complexity.  [Ref  7:p.  154] 

Direct  manipulation  (DM)  interfaces  are  newer.  They  are 
defined  by  Jacob  to  be  interfaces  that  present  a  set  of  visual 
representations  on  a  display  and  provide  a  repertoire  of 
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manipulations  that  can  be  performed  on  any  of  the  visual 
representations.  [Ref  8;p.  283] 

Using  these  interfaces,  the  user  performs  some  form  of 
action  directly  on  an  object  or  other  representation  (often 
referred  to  as  an  icon)  displayed  on  the  computer  screen.  DM 
systems  are  characterized  by  low  levels  of  interface 
complexity,  requiring  only  minimal  syntactic  knowledge  and 
semantic  knowledge  related  to  computer  use.  The  user  can  go 
directly  to  the  task  without  understanding  complex  computer 
concepts.  Since  icons  are  graphical  representations  of 
objects  or  actions  to  be  performed,  their  purposes  and  uses 
can  be  intuitive  if  they  are  well  designed.  Such  DM 
interfaces  require  only  that  the  user  understand  what  each 
icon  stands  for  and  what  operations  are  permitted  in  order  to 
perform  an  operation  successfully.  [Ref  9:p.  207] 

Novice  users  prefer  DM  interfaces  over  CL  interfaces 
because  only  the  operations  and  the  meanings  of  the  icons  must 
be  memorized.  On  the  other  hand,  CL  interfaces  are  preferred 
by  experienced  users  because  such  interfaces  are  more 
responsive  [Ref  7:p.  155].  Even  with  experts,  however,  at 
some  point  memorizing  complex  CL  commands  is  beyond  the 
eibility  of  most  users.  Thus  many  software  application 
programs  (e.g.,  dBase  IV)  provide  both  forms  of  interface  for 
their  users . 

Margono  and  others  compared  user  performance  with  DM  and 
CL  interfaces  for  file  management  and  operating  system  tasks. 
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They  determined  that  the  Apple  Macintosh  Computer  DM  file 
management  systems  are  easier  and  faster  to  learn  for  the 
novice  than  systems  using  the  CL  interface,  for  the  tasks  that 
were  tested.  Study  participants  had  limited  computer 
background.  [Ref  7:p.  158] 

Karat  has  determined  that  DM  operations  have  a  consistent 
performance  advantage  over  CL  interfaces  as  task  difficulty 
increases.  Karat  also  determined  that  DM  was  easier  to  use 
for  those  participating  in  his  study,  who  were  not  experienced 
in  file  management  systems.  [Ref  10 :p.  491] 

Te'eni  compared  the  feedback  provided  by  a  DM  interface 
to  that  from  a  CL  interface,  when  students  of  aui  information 
systems  management  course  calculated  their  final  course  grades 
based  on  midterm,  final  excun,  and  class  project  scores.  He 
determined  that  DM  interfaces  enheuice  cognitive  control  and 
require  less  effort  than  CL.  [Ref  11 :p.  22] 

No  apparent  dividing  line  has  been  established  to 
determine  the  conditions  under  which  DM  interfaces  are 
prefercible  to  CL  interfaces.  The  user's  level  of  expertise  is 
one  determining  factor.  The  level  of  task  complexity  is 
another.  A  third  factor  is  the  overall  interface  complexity 
that  results  from  the  combination  of  task  requirements  and  the 
specific  user.  That  is,  the  user's  pre-existing  computer  and 
task  knowledge  result  in  a  personal  perception  of  interface 
complexity. 
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B.  GOAL  AMD  SCOPE 

The  goal  of  this  study  is  to  determine  if  the  user  will 
benefit  from  the  use  of  a  DM  interface  over  a  CL  interface  for 
simple  and  complex  tasks.  Research  has  been  conducted  to 
evaluate  the  performance  differences  observed  between  users 
working  with  CL  interfaces  and  those  using  DM  interfaces  for 
two  levels  of  task  complexity. 

The  scope  of  the  study  is  limited  to  comparing  the 
relative  usefulness  of  the  two  types  of  user  interfaces  as  a 
function  of  task  complexity.  Only  two  levels  of  task 
complexity  were  considered  and  conditions  of  use  were  such 
that  stress  was  not  a  factor  in  the  experiment.  The  tasks 
involved  in  the  experiment  were  limited  to  computer  operating 
systems  tasks. 

Only  novice  users  were  included  in  the  study.  Thus  the 
effects  of  these  variables  on  performance  by  experts  cannot  be 
inferred  from  the  results.  Additionally,  the  study  was 
limited  to  25  subjects,  all  of  whom  were  masters  students  at 
a  military  institution  and  not  necessarily  representative  of 
the  general  population. 
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II.  COMPLEXITY  AMD  USER  INTERFACES 


A.  USER  INTERFACE 

The  user  interface,  as  described  by  Card  and  others,  is 
the  equipment  used  by  a  human  and  a  computer  to  engage  in  a 
communicative  dialogue  in  order  to  accomplish  a  task.  The 
process  is  considered  a  dialogue  because  both  the  user  and  the 
computer  have  access  to  the  stream  of  symbols  flowing  back  and 
forth  to  accomplish  the  communication;  each  cein  interrupt, 
query,  and  correct  the  communication  at  various  points  in  the 
process.  All  mechanisms  used  in  this  dialogue  constitute  the 
interface:  the  physical  devices,  such  as  the  keyboards  and 
displays,  and  computer  programs  for  controlling  the 
interaction.  [Ref  l:p.  4] 

Card  and  others  report  that  hximan  psychology  plays  a  major 
role  in  human-computer  interaction  and  should  be  considered  in 
the  design  of  a  user  interface.  The  three  psychology 
constructs  to  be  considered  are  perceptual,  cognitive,  and 
motor  [Ref  l:p.  24]  .  A  designer  of  a  user  interface  can  alter 
the  degree  of  difficulty  of  learning  and  using  computer 
applications  with  a  given  interface  by  varying  the  level  of 
input  and  output  related  to  the  three  interacting  h\jman 
subsystems  described  by  these  branches  of  psychology;  the 
perceptual  system,  the  cognitive  system,  and  the  motor  system. 
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1 .  Perceptual  System 

The  perceptual  system,  as  defined  by  Card  and  others, 
carries  sensations  of  the  physical  world  detected  by  the 
body's  sensory  systems  into  internal  representations  of  the 
mind  by  means  of  integrated  sensory  systems.  For  excimple,  a 
visual  stimulus  is  observed  by  the  eyes  and  stored  for  5±>out 
0.2  second  in  the  visual  image  store.  This  image  store  holds 
an  exact  representation  of  what  was  seen  by  the  eyes  while  it 
is  being  symbolically  coded.  The  visual  perceptual  system 
includes  central  vision,  peripheral  vision,  eye  movement,  and 
head  movement,  as  these  operate  as  an  integrated  system  to 
provide  a  continual  representation  of  the  visual  scene  to  the 
perceiver.  [Ref  l:pp.  25-34] 

2 .  Cognitive  System 

The  cognitive  system  of  an  individual  provides  the  a±>ility 
to  move  symbolic  information  obtained  from  the  sensory  image 
stores  to  working  memory,  where  it  is  combined  with 
information  previously  stored  in  long-term  memory  [Ref  l;p. 
24] .  In  other  words,  the  cognitive  system  processes 
information  from  the  perceptual  system  so  that  corresponding 
actions  can  be  output  via  the  motor  system  [Ref  l;p.  35]. 
Cognitive  psychology  is  the  science  of  studying  human 
information  processing. 

The  current  model  of  the  cognitive  system  includes  two 
forms  of  memory:  working  memory  to  hold  current  information. 


9 


and  long-term  memory  to  store  knowledge  for  future  use  [Ref 
l:p.  35],  According  to  Card  and  others,  working  memory 
contains  intermediate  products  of  thinking  and  the 
representations  produced  by  the  perceptual  system.  Working 
memory  is  where  all  mental  operations  obtain  their  operands 
and  leave  their  outputs.  It  also  consists  of  a  subset  of  the 
elements  in  long-term  memory  that  have  been  activated.  [Ref 
l:pp.  36-39] 

Long-term  memory  contains  the  user's  mass  of  availeO^le 
knowledge.  It  is  a  network  of  related  symbols  called  chunks, 
accessed  associatively  from  the  contents  of  working  memory. 
Long-term  memory  contains  not  only  facts,  but  procedures  and 
history  as  well.  [Ref  l:pp.  39-41] 

3 .  Motor  System 

The  motor  system  carries  out  the  responses  of  the 
perceptual  and  cognitive  systems.  Using  the  motor  system,  an 
individual's  thoughts  are  translated  into  action  by  activating 
patterns  of  voluntary  muscles.  For  computer  users  the  two 
most  importcuit  effectors  are  the  arm-hand- finger  system  and 
the  head-eye  system.  The  human  motor  system  must  be 
considered  in  developing  a  user  interface  to  ensure  that  a 
desired  action  can  be  physically  accomplished.  [Ref  l:p.  34] 
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B .  INTERFACE  COMPLEXITY 


1 .  Definition  of  Complexity 

Rasmussen  defines  complexity  as  a  combination  of  the 
number  of  goals  to  be  accomplished,  the  number  of  processes 
that  must  be  controlled,  and  the  ntimber  cuid  characteristics  of 
the  means  (devices)  available  for  this  control  [Ref  2:p.  24]. 
Complexity,  therefore,  is  a  function  of  two  components;  the 
task  (i.e.,  the  number  of  goals/processes)  and  the  user 
interface  (i.e.,  the  n\amber  of  characteristics  or  devices 
available  for  control) . 

a.  Task  Coa^laxity 

Task  complexity  in  relation  to  user  interfaces  is  not  well 
defined  in  the  literature.  It  is  apparent  that  simple  tasks 
have  a  better  chance  of  being  completed  successfully  than 
complex  tasks.  Unfortunately,  a  cut-off  point,  i.e.,  the 
number  of  instructions  or  steps  differentiating  a  complex  task 
from  a  simple  task,  has  not  been  defined.  Only  relative 
measures  of  complexity  between  tasks  have  been  compared.  For 
example,  the  task  of  turning  on  a  computer  (flipping  a  switch) 
is  considered  simple  when  compared  to  editing  a  text  file 
using  commands  such  as  insert,  delete,  copy,  etc.  The  latter 
is  considered  a  complex  task.  Task  complexity  is  described  in 
greater  detail  later. 
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Jb.  User  InterfacB  Complexity 


User  interface  complexity  generally  is  considered  as  the 
overall  complexity  of  a  system  or  device  from  a  user's 
perspective.  Kieras  and  Poison  call  this  cognitive  complexity 
[Ref  3:p.  365] .  This  form  of  complexity  is  dependent  on  the 
cunount,  content,  and  structure  of  the  knowledge  required  to 
operate  the  device  or  system.  For  a  new  user,  complexity  is 
also  determined  by  the  difficulty  of  acquiring  the  new 
knowledge  necessary  for  using  the  device  or  system.  For  the 
scope  of  this  study,  we  are  considering  task  complexity  but 
not  user  interface  complexity  (i.e.,  user  interface  complexity 
is  held  at  one  level) .  [Ref  3:pp.  364-365] 

2 .  Task  and  Device  Representations 
Kieras  and  Poison  identified  two  major  components  of  the 
knowledge  involved  in  operating  a  device  as  the  user's  task 
representation  and  the  user's  device  representation  [Ref  3:p 
366].  The  user's  task  representation  is  the  user's  knowledge 
of  how  to  carry  out  a  task,  which  may  be  described  by  the  GOMS 
model  developed  by  Card  and  others  [Ref  l:p  140-146] . 

Device  Representation  is  the  user' s  knowledge  of  that 
device  and  how  it  is  used  to  carry  out  tasks.  The  complexity 
of  a  device  is  determined  by  the  complexity  of  knowledge 
required  to  operate  the  device.  Kieras  emd  Poison  theorize 
that  device  complexity  depends  on  three  factors: 
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(1)  The  complexity  of  the  user's  task  representation,  and 
the  learning,  memory,  and  processing  capacity  demands 
implied  by  the  task  representation. 


(2)  The  number  of  device-dependent  functions  which  are  not 
part  of  the  user's  initial  task  representation,  and  the 
difficulty  of  learning  them. 


(3)  The  ease  with  which  a  user  can  acquire  how-it-works 
knowledge.  [Ref  l:p.  367] 


Additionally,  Kieras  and  Poison  identify  four  categories 

of  information  related  to  the  user's  knowledge  of  the  device. 

(1)  Task-relevant  knowledge  is  information  ed^out  the  goals 
that  the  device  can  be  used  to  satisfy,  the  operations  that 
can  be  performed  on  the  device,  and  the  operating  procedures 
for  the  device.  Such  knowledge  of  the  device  is  a 
counterpart  to  the  user's  task  representation. 


(2)  Device  layout  knowledge  is  knowledge  concerning  the 
physical  layout  of  the  device,  such  as  the  location  of 
controls,  the  format  of  the  display,  and  the  location  of 
various  switches  and  status  indicators. 


(3)  Device  behavior  knowledge  is  the  user's  understanding  of 
the  relationships  between  the  operation  of  various  controls 
and  the  external  behavior  of  the  device. 


(4)  How-it-works  knowledge  is  the  user's  understanding  of 
the  internal  structures  and  functions  of  the  device.  Such 
knowledge  is  assumed  to  enaible  a  user  to  generate 
explanations  e±>out  the  operating  procedures  and  the  behavior 
of  the  device,  and  eJsout  the  device-dependent  components  of 
the  task  representation.  [Ref  3:p.  367] 


The  combined  total  of  knowledge  in  each  of  these  categories 
determines  the  user's  knowledge  of  the  device  and  affects  the 
user's  eibility  to  operate  the  device  successfully. 
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3.  Predicting  Ease  of  Learning  and  Use 

Kieras  and  Poison  argue  that,  to  make  a  system  easy  to 
operate,  one  needs  to  make  the  knowledge  needed  to  operate  a 
system  as  simple  as  possible,  i.e.,  to  minimize  the  cognitive 
complexity  of  the  system.  By  extending  the  GOMS  model  to 
include  production  rules,  quantitative  predictions  can  be  made 
on  the  ease  of  learning  and  use  of  a  system.  This  is  known  as 
the  cognitive  complexity  approach.  [Ref  4:p.  1] 

The  GOMS  model  and  the  cognitive  complexity  approach  both 
characterize  the  procedural  knowledge  the  user  must  have  in 
order  to  operate  software,  such  as  an  operating  system.  GOMS 
describes  the  content  and  structure  of  this  knowledge,  while 
the  cognitive  complexity  approach  represents  the  amount  of  the 
knowledge.  [Ref  4:p.  4] 

Cognitive  complexity  models  are  descriptions  of  the 
required  procedural  knowledge  expressed  within  a  constrained 
production  system  architecture.  The  complexity  of  the  rules 
and  the  number  of  rules  needed  to  express  the  required 
knowledge  are  related  to  the  complexity  of  the  system  and  to 
the  eunount  of  knowledge  that  must  be  acquired  in  order  to  use 
it.  [Ref  4;p.  5] 

The  cognitive  complexity  of  an  interface  is  represented 
through  what  Kieras  and  Poison  refer  to  as  a  production 
system.  For  a  job-task  representation,  a  production  system 
consists  of  (1)  a  working  memory,  (2)  a  collection  of 
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production  rules,  and  (3)  an  interpreter,  according  to  this 
model.  [Ref  4:p.  7] 

The  production  system  working  memory  contains 
representations  of  current  goals  and  inputs  from  the 
environment  and  other  information  cibout  the  state  of  current 
and  past  actions  [Ref  4;p.  6].  The  production  system  model 
differentiates  between  two  forms  of  knowledge;  declarative 
knowledge  and  procedural  knowledge.  Declarative  knowledge  is 
defined  by  Kieras  and  Poison  as  the  knowledge  of  facts.  It  is 
represented  as  a  set  of  propositions  organized  as  a  semantic 
network.  Procedural  knowledge  is  defined  as  the  knowledge  of 
how  to  do  things  and  consists  of  production  rules.  [Ref  3:p. 
369] 

A  production  rule  is  a  condition  and  action  pair  of  the 
form: 

IF  (condition)  THEN  (action) . 

The  condition  of  a  production  rule  is  a  statement  about  the 
external  environment  or  the  contents  of  working  memory.  If 
the  condition  of  a  specific  rule  is  met,  the  action  of  the 
rule  is  executed.  Production  rules  may  be  standardized  in 
complexity  by  the  use  of  style  rules.  Style  rules  are  used  to 
constrain  a  set  of  production  rules  to  be  uniform  in  size  and 
aunount  of  content.  [Ref  4:p.  7] 

The  interpreter  operates  by  alternating  between 
"recognize"  and  "act"  phases.  During  the  recognize  phase,  the 
interpreter  compares  the  conditions  of  all  rules  against  the 
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contents  of  working  memory  to  look  for  matches .  During  the 
act  phase,  the  interpreter  will  execute  all  rules  that  have 
their  conditions  met.  [Ref  4:p.  7] 

According  to  Bovair  and  others,  the  standardized  and 
constrained  production  rules  that  are  used  to  carry  out  a 
given  job  or  task  can  serve  as  a  measure  of  the  complexity  of 
that  job  or  task.  Once  the  rules  are  identified,  they  can  be 
counted.  The  resulting  number  may  be  used  to  generate 
quantitative  predictions.  An  important  hypothesis  of  the 
production  system  model  is  that  the  niimber  of  production  rules 
correlates  directly  with  complexity.  More  rules  require  more 
learning  and  also  result  in  longer  times  to  execute  the 
specified  operation  [Ref  4:p.  6]. 

The  Kieras  and  Poison  cognitive  complexity  model  provides 
a  simple  yet  credible  way  to  measure  auid  evaluate  cognitive 
and  task  complexity.  This  is  the  model  that  has  been  selected 
for  use  in  this  study. 

C .  TASK  COMPLEXITY 

As  discussed  by  Wood  [Ref  6:p.  60],  task  complexity  has 
presented  a  major  problem  in  accvimulating  data  on  task  effects 
primarily  because  it  has  been  difficult  to  define  task 
complexity.  The  Task  Complexity  Model  developed  by  Wood 
defines  three  components  of  task  complexity:  products, 
required  acts,  and  information  cues.  Based  on  these 
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components.  Wood  defines  three  forms  of  task  complexity: 
component,  coordinative,  and  dyncunic. 

1 .  Task  Coxi^lexity  Consonants 

Wood  defines  task  products  as  entities  that  are  created  or 
produced  by  behaviors  that  can  be  observed  and  described 
independently  of  the  behaviors  or  acts  that  produce  them.  In 
other  words,  products  are  the  measurable  results  of  acts.  A 
product  is  an  eQ:>stract  quality  of  a  task  which  is  independent 
of  the  goals  and  expectations  of  individuals  who  perform  or 
evaluate  tasks.  [Ref  6:p.  64] 

Required  acts  include  a  pattern  of  behaviors  with  some 
purpose  or  direction.  The  direction  of  an  act  is  usually 
implicit  in  the  verb  used  (e.g.,  copy,  rename,  delete)  and 
provides  a  focus  toward  the  lower  level  of  mental  and  physical 
activities  that  make  up  the  act.  It  is  this  directional 
aspect  which  separates  one  act  from  another.  [Ref  6:p.  64] 

The  direction  of  an  act  is  the  specific  kind  of  activity 
or  process  carried  out  when  an  act  is  performed.  Direction 
can  be  described  independently  of  emy  individual  who  actually 
performs  the  act  and  any  context  in  which  the  act  is 
performed.  This  is  a  fundeunental  attribute  of  Wood's  model. 
[Ref  6:p.  65] 

Information  cues  are  pieces  of  information  about  the 
attributes  of  stimulus  objects .  An  individual  bases  the 
judgements  he  or  she  is  required  to  make  during  the 
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performance  of  a  task  on  the  available  information  cues.  [Ref 
6:p.  65] 

Required  acts  and  information  cues  are  important  task 
inputs  because  they  set  upper  limits  on  the  knowledge,  skills, 
and  resources  individuals  need  for  successful  task  completion. 
Therefore,  task  complexity,  which  describes  the  relationships 
between  task  inputs,  is  an  important  determinant  of  human 
performance  through  the  demands  it  places  on  the  knowledge, 
skills,  and  resources  of  individual  task  performers.  [Ref  6:p. 
66] 

2 .  Types  of  Task  Complexity 

Wood  defines  the  component  complexity  of  a  task  as  a 
direct  function  of  (1)  the  nvimber  of  distinct  acts  that  must 
be  executed  in  the  performance  of  the  task  emd  (2)  the  number 
of  distinct  information  cues  that  must  be  processed  in  the 
performance  of  those  acts.  As  the  number  of  acts  increase  the 
knowledge  and  skill  requirements  for  a  task  also  increases, 
simply  because  there  are  more  activities  and  events  that  an 
individual  must  be  aware  of  and  able  to  perform.  [Ref  6:pp. 
66-67] 

Coordinative  complexity  refers  to  the  nature  of 
relationships  between  task  inputs  and  task  products.  The  form 
and  strength  of  the  relationships  between  information  cues, 
acts,  and  products,  as  well  as  the  sequencing  of  inputs,  are 
all  aspects  of  coordinative  complexity.  This  includes  timing. 
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frequency,  intensity,  and  location  requirements  for 
performance  of  required  acts.  [Ref  6:pp.  68-70] 

Dynamic  complexity  is  due  to  the  changes  in  the  states  of 
the  world  which  have  an  effect  on  the  relationships  between 
task  inputs  and  products.  The  pareimeter  values  for  the 
relationships  between  task  inputs  and  products  are 
nonstationary.  Changes  in  either  the  set  of  required  acts  and 
information  cues  or  the  relationships  between  inputs  and 
products  can  create  shifts  in  the  knowledge  or  skills  required 
for  a  task.  [Ref  6;pp.  71-73] 

Performance  of  a  dyneunically  complex  task  requires 
knowledge  about  changes  over  time  in  the  component  and 
coordinative  complexities  of  a  task.  Total  task  complexity  is 
a  linear  combination  of  the  component,  coordinative,  and 
dyncunic  complexities  of  a  task.  Variations  in  task  complexity 
appear  to  produce  changes  in  knowledge,  skill,  and  effort 
requirements  for  successful  task  performance.  These 
requirements  or  task  demands  depend  on  the  combinations  of 
component,  coordinative,  and  dynamic  con5)lexities  which  make 
up  total  complexity.  [Ref  6:pp.  73-74] 

D .  USER  INTERFACES 

Rasmussen  describes  a  good  user  interface  facility  as  one 
of  the  most  important  con55onents  of  an  information  system. 
The  value  of  a  system  is  reduced  greatly  if  it  has  not  been 
provided  a  useful  and  flexible  user  interface  [Ref  2:p.  152]. 
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Much  attention  has  been  given  to  user  interfaces  in  recent 
years  and  several  distinct  varieties  of  interfaces  have  been 
developed.  Two  of  these,  commeind  language  interfaces  and 
direct  manipulation,  are  the  most  common,  and  discussed  below. 

1 .  Command  Language  Interfaces 

Command  language  interfaces  require  the  user  to 
communicate  with  the  computer  by  typing  a  formal  language  with 
specific  syntax.  The  user  is  required  to  learn  and  memorize 
the  commands  and  the  sequences  needed  for  an  operation.  [Ref 
7:p.  154] 

As  mentioned  earlier,  command  language  interfaces  are 
preferred  by  expert  users  because  all  input  is  performed  at 
the  keyboard.  The  user  can  input  and  manipulate  the  interface 
without  having  to  move  from  the  keyboard  to  the  mouse.  This 
advantage  of  efficiency  and  flexibility  on  the  part  of  the 
expert  outweighs  some  advantages  of  direct  manipulation  type 
interfaces.  [Ref  7;p.  155] 

The  major  disadvantage  of  command  language  interfaces  is 
that  there  are  many  sources  for  possible  errors .  According  to 
Margono,  these  sources  include  the  following; 

1.  Difficulty  of  memorizing  commands.  The  following 
are  common  memory-related  problems  that  result  in 
errors . 

a.  Confusion  of  the  syntax  of  the  language  with 
English  syntax. 

b.  Inconsistency  in  the  command  language  syntax. 
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c.  Arbitrary  syntax  (e.g.,  commands  consisting  of 
punctuation  marks) . 

d.  Ease  of  making  errors  when  typing  the  commands. 

e.  Mismatches  between  the  user's  intention  in  the 
task  domain  and  the  computer  terminology  or 
syntax.  [Ref  7:p.  154] 

2 .  Uncertainty  of  whether  a  certain  command  did  what 
the  user  expected  (i.e.,  the  user  may  have  to 
display  a  directory  after  performing  a  certain 
command  to  see  if  a  file  has  been  deleted,  copied, 
etc. ) . 

3.  Incdsility  to  scroll  command  language- level  directory 
lists  backward  and  forward  when  searching  for 
specific  files.  [Ref  7:p.  155] 

Command  language  interfaces  may  give  the  user  an 

impression  of  indirectness.  The  use  of  a  specified  language 

implies  an  intermediary  system  between  the  user  and  the 

computer.  [Ref  7;p.  154] 

2 .  Direct  Manipulation  Interface 

According  to  Margono  and  others,  most  people  form  pictures 
in  their  minds  of  tasks  to  be  performed.  People  who  translate 
tasks  into  pictures  may  more  easily  understand,  learn,  and 
memorize  when  they  can  visualize  objects  and  actions.  In 
direct  manipulation  interfaces,  the  visual  representation  of 
the  objects  and  actions  should  match  the  way  people  think 
cdjout  the  problem.  [Ref  7:p.  154] 

Direct  manipulation  enables  the  user  to  control  system 
activities  by  direct  action  on  objects  rather  than  by  use  of 
procedural  language.  The  computer  system  provides  feedback  to 
the  user  concerning  the  user's  actions  on  these  objects.  This 
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feedback  is  the  cognitive  material  that  is  processed  by  the 
cognitive  system.  The  use  of  direct  manipulation  is  popular 
in  software  products  because  it  gives  the  user  a  sense  of 
satisfaction  while  interacting  with  the  system.  Additionally, 
the  feeling  of  "directness”  gives  the  user  the  impression  that 
the  computer  and  the  interface  are  "invisible."  [Ref  7:p. 
154] 

Icons  are  graphical  representations  of  the  objects  or 
actions  in  a  direct  manipulation  interface.  When  an  icon  is 
activated  with  the  use  of  a  mouse  or  other  pointing  device, 
the  system  performs  an  operation  that  can  be  associated  with 
the  user's  visual  representation  of  the  operation.  New  users 
find  it  easier  to  recognize  and  select  an  icon  rather  than  to 
learn  the  meaning  of  a  set  of  command  naimes  and  then  recall 
the  exact  syntax  of  the  command.  Icons  are  therefore  used  to 
reduce  the  complexity  of  a  system  and  make  it  easier  to  use. 
Interface  systems  using  icons  give  an  immediate  positive 
impression  that  the  system  is  easy  to  learn  and  use.  [Ref 
12;p.  105] 

The  major  disadvantage  of  icon-based  interfaces  is  the 
time  required  to  move  the  hand  from  the  keyboard  to  the  mouse, 
locate  the  appropriate  icon,  use  the  mouse  to  move  the  cursor 
to  the  icon,  and  then  select  the  icon.  Experienced  users 
sometimes  find  this  process  annoying  and  inefficient.  [Ref 

12:p.  108] 
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E.  SUMMARY 


To  summarize,  the  complexity  in  human- computer  interaction 
is  a  function  of  two  conponents:  task  and  user  interface 
complexity.  User  interfaces  can  be  classified  based  on  their 
method  of  communicating  between  the  user  and  the  computer,  two 
of  which  include  command  leuiguage  and  direct  manipulation. 
There  is  reason  to  expect  performeuice  to  be  better  using 
direct  manipulation  as  opposed  to  commcuid  language  interfaces. 
The  question  remains:  What  are  the  relative  efficacies  of 
direct  manipulation  and  command  language  interfaces  at 
multiple  levels  of  task  complexity? 
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III.  METHODOLOGY 


A.  EXPERIMENTAL  DESIGN 

The  purpose  of  this  study  was  to  excimine  the  relative 
effectiveness  of  a  DM  interface  (DMI)  versus  a  CL  interface 
(CLI)  at  different  levels  of  task  complexity.  A  mixed 
between-sub jects/within-sub jects  design  was  used.  As  TaJ^le  1 
indicates,  the  type  of  interface  (DMI  versus  CLI)  was 
operationalized  as  the  between-sub jects  factor.  Task 
complexity  (simple  versus  complex)  was  operationalized  as  the 
within-sub jects  factor. 


Between 

Subjects 


TABLE  1 

EXPERIMENTAL  DESIGN 


Interface 

Conditions 

Task  Conditions 

CLI 

Simple 

Task 

Complex 

Task 

DMI 

Simple 

Task 

Complex 

Task 

Within  Sxabjects 


1 .  Independent  Variables 

The  independent  variables  for  this  study  were  (1)  type  of 
interface  (CLI  or  DMI)  and  (2)  task  complexity.  The  two 
interfaces  are  described  in  detail  in  a  later  section.  Task 
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complexity  was  calculated  by  determining  the  number  of  inputs 
and  outputs  required  for  each  task.  For  the  simple  task  set, 
the  average  number  of  inputs  and  outputs  was  determined  to  be 
five.  For  the  complex  task  set,  the  average  number  was 
determined  to  be  24.  Thus  an  average  of  approximately  80% 
more  inputs  and  outputs  was  required  for  the  complex  task  set 
over  the  simple  task  set. 

2 .  Dependent  Variables 

The  dependent  variables  for  which  performance  was 
measured  were  (1)  time  to  complete  each  task  set,  (2)  number 
of  errors  that  occurred  during  completion  of  the  task  set,  and 
(3)  the  number  of  times  on-line  help  was  referenced.  Each 
participant's  thinking  style  also  was  determined.  A 
Verbalizer-Visualizer  Questionnaire  (WQ)  test  was  used  to 
measure  the  degree  to  which  pictorial  '  or  verbal 
representations  are  normally  stored  and  accessed  by  each 
subject  as  he  or  she  carries  out  various  tasks.  The  WQ 
contains  15  questions,  each  pertaining  to  a  visual  or  verbal 
way  of  thinking.  Each  svibject  was  given  a  score  on  a  scale  of 
1-15.  A  low  score  indicates  strong  verbalizing  tendencies  and 
a  high  score  indicates  strong  visualizing  tendencies.  [Ref 
13:pp.  109-124] 

A  user  log  was  generated  for  each  user  as  each  task  set 
was  performed.  For  every  operation,  the  total  completion 
time,  operation  code,  and  description  of  the  operation  were 
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recorded  in  the  user  log.  Additionally,  the  various  errors 
that  could  occur  automatically  were  coded  to  permit 
categorizing  the  errors  for  further  analysis. 

For  the  data  gathering  runs,  time  to  complete  the  task 
set  was  calculated  as  the  difference  in  minutes  between  the 
time  the  subject  logged  onto  the  system  and  the  time  that  the 
last  operation  in  a  task  set  was  completed.  The  time  reported 
for  the  practice  session  also  included  the  time  required  by 
the  user  to  read  the  instructions  and  other  information  and 
time  required  to  learn  to  use  the  interface.^ 

Errors  included  all  task  set  operations  that  were 
performed  incorrectly.  Errors  automatically  recorded  in  the 
user  log  by  the  software  were  counted,  along  with  others 
discovered  during  a  manual  review  of  the  user  log  file.  This 
manual  review  was  necessary  to  determine  whether  all 
operations  were  performed  and  were  performed  correctly. 

The  number  of  times  the  user  referred  to  the  CLI  or  DMI 
help  screens  was  automatically  logged  for  each  task  set.  This 
variable  was  considered  a  measure  of  the  ease  or  difficulty  of 
remembering  how  to  use  the  interface,  after  training  was 
completed. 


^  In  some  instances  it  was  necessary  to  restart  the  practice  session  to 
allow  the  subject  additional  practice  time.  The  total  time  for  the  practice 
session  included  the  times  for  the  initial  practice  session  and  the  second 
practice  session. 
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B .  HYPOTHESES 

A  total  of  three  hypotheses  were  tested  for  this  study. 

•  Hypothesis  1 :  Conflation  Time 

The  time  required  to  learn  how  to  carry  out  the 
tasks  and  to  complete  the  practice  session  will  be 
significantly  greater  for  the  DM  interface  than  the 
time  required  to  learn  and  complete  the  practice 
session  using  the  CL  interface. 

Hib  The  time  required  to  complete  the  simple  task  set 
will  not  be  significantly  different  between  the  two 
interfaces . 

Hjc  The  time  required  to  complete  the  complex  task  set 
using  the  CLI  will  be  significantly  greater  than  the 
time  required  to  complete  the  complex  task  set  using 
the  DMI. 

•  Hypothesis  2 :  Number  of  Errors 

Hj*  The  number  of  errors  that  occur  during  the  practice 
session  will  be  significantly  greater  while  using 
the  DMI  than  the  number  of  errors  measured  while 
using  the  CLI. 

Hjb  The  niomber  of  errors  that  occur  while  completing  the 
simple  task  set  will  not  be  significantly  different 
between  the  two  interfaces . 

Hjc  The  number  of  errors  that  occur  while  completing  the 
complex  task  set  will  be  significantly  greater  while 
using  the  CLI  than  the  number  of  errors  measured 
while  using  the  DMI . 

•  Hypothesis  3:  Ntunber  of  Help  References 

Hjx  The  number  of  times  the  help  screen  is  referenced 
during  the  practice  session  will  be  significantly 
greater  for  the  DMI  condition  than  the  number  of 
times  the  help  screen  is  referenced  for  the  CLI 
condition. 

Hjb  The  number  of  times  the  help  screen  is  referenced 
during  the  simple  task  set  will  not  be  significantly 
different  for  the  DMI  condition  than  for  the  CLI 
condition . 
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Hac  The  nxunber  of  times  the  help  screen  is  referenced 
during  the  complex  task  set  will  be  significantly 
greater  while  using  the  CLI  than  the  number  of  times 
the  help  screen  is  referenced  while  using  the  DMI . 

C .  SUBJECTS 

Svibjects  for  the  experiment  consisted  of  27  active  duty 
military  officers  enrolled  in  various  master' s  degree  progrcuns 
at  the  Naval  Postgraduate  School,  Monterey,  California.  Four 
svibjects  were  female  and  23  male.  The  subjects  ranged  in  age 
from  27  to  38  years  old,  with  a  mean  age  of  31.5  years.  The 
subjects  were  randomly  divided  into  two  groups.  Of  these,  i3 
used  the  CL  interface  and  the  DM  interface  for  the  trials. 
The  level  of  experience  was  controlled  by  selecting  novice 
svibjects;  all  svibjects  had  little  or  no  experience  with 
computer  operating  systems. 

D .  APPARATUS 

Both  of  the  interface  systems  tested  for  the  study  were 
developed  to  interact  with  the  Microsoft  Disk  Operating  System 
(MS-DOS)  ,  and  used  the  scime  hardware  with  the  exception  that 
a  mouse  was  required  for  the  DM  interface  and  a  keyboard  for 
the  CL  interface.  All  trials,  under  all  conditions,  were 
conducted  in  a  controlled  environment  on  Unisys  386  personal 
computers  with  VGA  color  monitors  and  math  co-processors. 
Task  operations  were  conducted  using  floppy  disks,  referred  to 
as  the  data  disks.  These  data  disks  were  used  for  both 
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interfaces.  The  subjects  were  at  no  time  permitted  access  to 
the  hard  drive. 

Subjects  were  seated  comfortably  in  front  of  the 
terminals  and  were  allowed  to  adjust  viewing  distance, 
keyboard  placement,  and  the  location  of  the  mouse  as  desired. 
No  more  than  five  sxibjects  were  tested  at  any  one  time.  The 
computer  room  was  cpiiet,  and  distractions  that  might  influence 
test  outcomes  were  minimized. 

B .  TASKS 

The  tasks  carried  out  by  the  subjects  were  the  same  for 
both  interfaces .  For  the  simple  task  condition,  users 
manipulated  14  files  stored  in  two  directories.  The  simple 
task  set  consisted  of  the  following. 

1.  Create  a  svibdirectory  called  plots  under  the  root  (\) 
directory. 

2.  Create  a  new  file  called  twoplots .drs  in  the  newly- 
created  directory  called  plots. 

3.  Delete  the  file  called  project.bak  from  the  project 
directory. 

4.  Copy  the  plot. drs  file  that  is  contained  in  the  root 
directory  to  plot .bak  in  the  root  directory. 

5.  Rename  the  file  called  twoplots  .drs  in  the  plots 
directory  to  twoplot.bak  in  the  plots  directory. 

For  the  complex  task  condition,  the  complexity  of  the 
tasks  was  increased  by  the  addition  of  directories  and  files, 
and  by  combining  operations.  A  total  of  15  subdirectories  and 
102  files  were  included  for  use  in  carrying  out  various  tasks 
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in  the  complex  task  set.  The  complex  task  set  included  the 
following  five  tasks. 

1 .  Copy  the  package  file  in  the  business  directory  to  the 
box  file  in  the  business  directory. 

2.  Rename  the  papers  file  in  the  supplies  directory, 
which  is  a  subdirectory  of  business,  to  document  in  the 
supplies  directory. 

3.  Create  a  file  called  car  in  the  ground  directory, 
which  is  a  subdirectory  of  transpor.  Then  sort  the  files  in 
the  ground  directory  by  size. 

4.  Delete  the  planes  directory.  This  requires  deleting 
four  files  in  the  jets  directory  and  two  files  in  the  planes 
directory,  then  deleting  the  jets  directory  and  the  planes 
directory . 

5.  Find  the  largest  file  of  all  the  directories  and 
rencune  the  file  to  large,  f  11.  This  requires  sorting  102  files 
in  15  different  subdirectories,  determining  that  the  file 
nauned  ship  in  the  transpor  directory  is  the  largest  file,  and 
renciming  it  to  large,  f  11. 

F.  COMMAND  IiANGUAGE  INTERFACE 

The  same  CL  interface  was  used  for  the  practice,  simple 
and  complex  task  sets.  Svibjects  assigned  to  the  CL  prototype 
interface  test  condition  received  the  Command  Language 
Interface  (CLI)  instruction  set  (Appendix  B)  .  This 
instruction  set  included  a  brief  introduction  to  computer 
operating  systems  and  file  management,  and  a  detailed 
description  of  the  CLI  they  would  use. 

The  CLI  was  developed  in  the  C  progreimming  language  for 
the  experiment.  It  was  not  designed  to  be  a  fully  functional 
DOS  shell.  Instead,  only  the  sets  of  tasks  used  for  the 
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trials  were  supported  (see  Appendix  C  for  a  list  of  CLI 
commands  available) . 

Figure  1  illustrates  the  basic  window  structure  for  the 
CLI.  The  interface  includes  three  windows:  (1)  Directory 
window  which  displays  the  directory  tree,  (2)  File  window 
which  displays  the  files  stored  in  a  specified  directory 
identified  in  the  IcdDel,  and  (3)  Command  window  which 
displays  user-input  commands,  as  typed  on  the  keyboard.  The 
keyboard  is  the  only  input  device  used  for  the  CLI  condition. 


Figure  1  Command  Language  Interface  Basic  Window 
Structure. 


31 


Figure  2  shows  the  general  Help  screen  that  is  displayed 
when  the  coininand  help  is  entered  at  the  command  line  in  the 
Command  window.  If  a  portion  of  the  screen  is  obstructed  by 
the  windows,  the  user  is  prompted  to  type  "M"  for  more.  The 
user  can  obtain  a  detailed  description  of  each  command  by 
typing  the  words  help  command,  followed  by  the  name  of  the 
command  for  which  information  is  desired.  Figure  3  provides 
an  exeunple  of  the  Help  screen  for  the  createfile  command. 


DIRECTORY  WINDOW 


HELP:  GENERAL 

1 .  The  Command  Lenuage  Interface  provides  a  method  of  managing  files  and  directories. 

2.  All  commands  are  to  be  typed  in  lower  case  at  the  command  line,  i.e.,  bottom  of  the 
screen. 

3.  All  commands  invovtlng  drectorles  are  assumed  to  be  at  the  \  or  *root"  dhectory, 
therefore,  the  \  does  not  need  to  be  typed  when  specifying  a  ditectory. 

4.  Directory  Information  Is  provided  In  the  top  portion  of  the  screen  end  file  information  In 
the  middle  of  the  screen. 

5.  Commands  Include  the  following: 

copyflle 

cieatedlr 

Press  M  for  more,  or  any  other  key  to  e^dt. 


COMMAND  WINDOW 


COMMAND->  help 


Figure  2  General  CLI  Help  Screen. 
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DIRECTORY  WINDOW 


HELP:  CREATEFILE 

1 .  CREATEFILE  allows  the  user  to  create  a  new  file  In  a 
specfflc  directory. 

2.  CREATEFILE  syntax: 

createflle  <directory\new  file  name> 


STRIKE  ANY  KEY  TO  CONTINUE 


COMMAND  WINDOW 


COMMAND«>  help  createflle 

Figure  3  Help  Screen  for  the  Createflle  Command. 


Figure  4  illustrates  the  directory  tree  that  is  displayed 
when  dirtree  is  typed  on  the  keyboard  and  displayed  at  the 
command  line.  The  Directory  window  then  displays  the  names  of 
all  the  directories  contained  on  the  data  disk. 

All  commands  are  typed  on  the  keyboard  and  displayed  at 
the  command  line.  Only  one  syntactical  format  is  correct  for 
each  command.  If  the  user  types  a  command  incorrectly,  omits 
an  argument,  or  specifies  a  non-existing  file  or  directory,  an 
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error  message  appears  in  reverse  video  at  the  base  of  the 
Command  window,  as  shown  in  Figure  5.  The  error  message 
indicates  the  type  of  error,  but  not  the  corrective  action  to 
be  taken. 


DIRECTX>RY  WINDOW 
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ANIMALS 
--  PEOPLE 
SPECIAL 


RLE  WINDOW 


COMMAND  WINDOW 


COMMAND->  dlrtreo 


Error  in  oommand.  lype  HELP  for  help 
STRIKE  ANY  KEY  TO  CONTINUE 


Figure  4  Directory  Tree  Screen  for  the  CLI  Condition. 
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DIRECTDRY  WINDOW 


I—  ANIMALS 
U-  PEOPLE 
L-.  SPECIAL 


COMMAND  WINDOW 


COMMAND">  listfllos  animal 


Error  In  oommand.  Typo  HELP  for  help 
STRIKE  ANY  KEY  TO  CONTINUE 


Figure  5  Screen  with  CLI  Error  Message. 

1 .  Practice  Session  Screens 

Figure  6  shows  an  example  CLI  screen  used  for  the 
practice  session.  The  user  has  given  commands  to  display  the 
directory  tree  (dirtree)  and  to  list  the  files  (listfiles)  in 
the  animals  directory. 

2 .  Screens  Used  for  the  Single  Task  Set 

Figure  7  shows  an  example  CLI  screen  for  the  simple  task 
set.  The  user  has  displayed  the  directory  tree  (dirtree)  and 
listed  the  files  in  the  project  directory  (listfiles  project) . 
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DIRECTORY  WINDOW 


-•  ANIMALS 
-•  PEOPLE 
-  SPECIAL 


COMMAND  WINDOW 


COMMAND->  llstfllQS  animals 


Figure  6  Practice  Session  Screen  for  the  CLI  Condition. 
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DIRECTORY  WINDOW 


— .  PROJECT 


FILES  IN  DIRECTORY:  project 


Volume  In  drive  B  has  no  label 
Directory  of  B:\PROJECT 

<DIR>  2-06-91  12;00p 

<DIR>  2-06-91  12:09p 

PROJECT  .BAK  30818  4-28-88  e:44p 

PROJECT  .CHG  567  11-21-90  6;59p 

Press  M  for  more,  or  anv  other  kev  to  exit 


COMMAND  WINDOW 


COMMAND->  llstflles  project 


Figure  7 


CLI  Screen  for  Simple  Task  Set. 
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3 .  Screens  Used  for  the  Cos^lex  Task  Set 

The  same  interface  with  the  same  set  of  functions  was 
used  for  the  complex  task  set.  Figure  8  provides  an  excunple 
of  CLI  screen  for  the  complex  task  set.  The  user  has 
displayed  the  directory  tree  <dirtree)  and  listed  the  files  in 
the  business  directory  (listfiles  business) . 


BUSINESS 
FLAGS  — 


MILITARY  - 
TRANSPOR 


DIRECTORY  WINDOW 


SUPPLIES 
EAST 
NORTH 

—  SOUTH 

-  WEST 

-—PLANES - JETS 

AIRTRANS 


1 


RLES  IN  DIRECTORY:  business 


Volume  In  dilvs  D  hss  no  labs) 

Directory  of  B:Vbuslness 

<DIR>  1-30-91  11:28a 

<DIR>  1-3091  11:28a 

BAG  1333  1-31-01  12iXto 

BEARMKT  5877  1-31-01  12.U0p 

_ Press  M  for  mote,  or  arry  other  key  to  exit 


COMMAND  WINDOW 


COMMAND">  listfiles  business 


Type  a  command  and  pieas  ENTER,  or  type  EXIT  ID  end  session 


Figure  8  CLI  Screen  for  Complex  Task  Set. 
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6. 


DIRECT  HANIPUIATION  INTERFACE 


The  same  DM  interface  was  used  for  all  three  task  sets. 
Subjects  assigned  to  the  DM  prototype  interface  test  condition 
received  the  Direct  Manipulation  Interface  (DMI)  instruction 
set  (Appendix  D)  .  This  instruction  set  included  the  same 
description  of  operating  systems  and  file  management  as  the 
CLI  instructions,  along  with  a  detailed  description  of  the 
DMI. 

The  DMI  was  progreunmed  with  the  object-oriented 
programming  language,  Smalltalk,  for  the  purpose  of  this 
experiment.  Like  the  CLI,  only  the  task  sets  used  for  the 
trials  were  supported  by  this  interface  (see  Appendix  C  for  a 
list  of  DMI  commands  availcible)  . 

Figure  9  illustrates  the  basic  structure  for  the  DMI . 
The  interface  includes  five  windows;  (1)  Directory  window 
which  displays  the  hierarchical  directory  structure,  (2)  File 
window  which  displays  the  files  listed  in  a  specified 
directory,  (3)  File  Sort  window  which  allows  the  user  to  sort 
files  by  name,  date  of  creation,  or  size,  (4)  New  Name  window 
which  contains  all  allowed  names  needed  for  new  files,  rencuned 
files,  and  new  directories,  and  (5)  Icon  window  which  contains 
all  the  icons  used  for  tasks  operations.  Figure  10  shows  an 
example  of  an  actual  DMI  screen.  Although  a  keyboard  was 
present,  the  mouse  is  the  only  input  device  used  for  the  DMI 
condition. 


39 


RLE  SORT 

NEW 

UAME 

WINDOW 

WINDOW 

ICON 

WINDOW 

DIRECTORY 

WINDOW 


RLE 

WINDOW 


Figure  9  Direct  Manipulation  Interface  Basic 
Window  Structure. 


Figure  11  shows  the  general  Help  window  that  is  displayed 
on  the  screen  when  the  help  icon  is  selected.  The  user 
selects  the  naune  of  the  item  in  question  by  placing  the  mouse 
cursor  over  that  neune  and  pressing  the  left  mouse  button.  The 
right  side  of  the  Help  window  then  will  display  the  step-by- 
step  procedures  for  the  specific  operation.  Figure  12  is  an 
example  of  the  Help  window  with  the  Create  Directory  option 
selected. 
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Figure  10  Direct  Manipulation  Basic  Window  Structure. 
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Figure  11  General  DMI  Help  Window. 
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Figure  12  Help  Window  for  the  Create  Directory  Option. 


Figure  13  illustrates  the  directory  tree  that  is 
displayed  when  directory  tree  icon  is  selected.  The  Directory 
Tree  window  then  displays  the  names  of  all  the  s\abdirectories 
contained  on  the  data  disk. 

When  the  user  performs  an  operation  properly  on  a  file  or 
directory  a  Prompter  window  appears  allowing  the  user  to 
accept  or  cancel  the  operation,  as  shown  in  Figure  14.  If 
insufficient  information  is  provided  for  an  operation,  a 
Prompter  window  appears  containing  a  simple  error  message, 
illustrated  in  Figure  15.  As  with  the  CLI,  error  messages 
indicate  what  has  been  done  incorrectly,  but  not  the 
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corrective  action  to  be  taken.  If  the  user  tries  to  perform 
an  operation  that  is  not  allowed  by  DOS,  an  Error  window  with 
a  short  message  in  the  label  appears  in  the  middle  of  the 
screen.  This  error  message  is  generated  by  Smalltalk.  The 
Smalltalk  code  generated  during  the  execution  of  the  operation 
is  displayed  in  the  lower  portion  of  the  window,  as  seen  in 
Figure  16.  This  window  is  used  to  determine  the  reason  for 
the  error  identified  in  the  label. 
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Figure  13  Directory  Tree  Window  for  the  DMI  Condition. 
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Prompter  Window  for  the  Pathname  Option. 
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Figure  15  Prompter  Window  with  Simple  DMI  Error  Message. 
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Figure  16  Smalltalk  Error  Window. 


1 .  Practice  Session  Screens 

Figure  17  shows  an  example  DMI  screen  used  for  the 
practice  session.  The  user  has  selected  icons  commanding  that 
the  animals  directory  be  displayed,  along  with  its  files. 

2.  Screens  Used  for  the  Single  Task  Set 

Figure  18  shows  an  example  DMI  screen  for  the  simple  task 
set.  The  user  has  selected  the  project  directory.  The  files 
are  automatically  displayed  in  the  File  window  and  the  File 
Sort  window. 
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Figure  17  Practice  Session  Screen  for  the  DMI  Condition. 
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Figure  18  DMI  Screen  for  Simple  Task  Set. 


3.  Screens  Used  for  the  Con^lex  Task  Set 

The  same  interface  with  the  saune  set  of  functions  was 
used  for  the  complex  task  set.  Figure  19  shows  an  example  DMI 
screen  for  the  complex  task  set .  The  user  has  selected  the 
business  directory.  The  files  are  automatically  displayed  in 
the  File  window  and  the  File  Sort  window. 
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Figure  19  DMI  Screen  for  Complex  Task  Set. 


H.  EXPERIMENTAL  PROCEDURE 

Siibjects  were  brought  into  the  computer  room  and  told 
that  they  would  be  asked  to  carry  out  some  tasks  on  a 
prototype  operating  system  interface.  Each  subject  then 
logged  onto  the  Unisys  386  computer  system  by  providing  neime 
and  student  mailbox  number  (SMC) .  The  experimenter  then 
provided  each  siabject  with  an  instruction  set  (Appendix  B  or 
D)  .  The  STibject  read  a  short  introduction  to  the  experiment 
and  a  privacy  act  statement.  The  WQ  was  completed  next,  to 
determine  thinking  style  (verbal  or  visual) .  The  subjects 
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then  read  the  information  on  file  management,  the  operating 
system  interface  he  or  she  would  use,  and  the  tasks.  The  two 
instruction  sets  (CLI  and  DMI)  were  identical  except  for  the 
description  of  the  interface  and  the  practice  session 
procedures.  Information  was  provided  only  about  the  interface 
that  would  be  used  by  that  stibject. 

1 .  Training  and  Practice  Session 

After  reading  the  instruction  set  the  subjects  were  told 
to  practice  nine  practice  operations  (described  in  the 
instruction  set) ,  repeating  each  as  many  times  as  necessary 
until  it  could  be  completed  successfully.  The  nine  operations 
were  designed  to  familiarize  the  user  with  the  interface  and 
the  operations  to  be  used  during  the  experiment.  The  practice 
session  included  the  following  file  operations. 

1.  Call  up  on-line  help 

2.  Create  a  file 

3.  Sort  files 

4.  Delete  a  file 

5.  Copy  a  file  and  Rename  a  file. 

Directory  operations  included: 

1 .  Create  a  directory 

2.  Call  up  the  directory  tree 

3.  Delete  a  directory. 

The  user  was  not  limited  to  these  nine  operations . 

The  file  management  and  interface  descriptions  were 
available  for  reference  during  the  practice  session.  After 
completing  the  practice  session,  each  sxabject  was  asked  if  he 
or  she  felt  comfortable  with  the  interface,  before  continuing 
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with  the  experiment.  If  not,  he  or  she  was  permitted  to 
repeat  the  practice  session.  The  average  time  spent  in 
training  and  practice  for  CLI  was  approximately  9.9  minutes 
with  a  range  of  6.4  to  17.5  minutes.  Average  time  spent  in 
training  and  practice  for  DMI  was  approximately  42.5  minutes 
with  a  range  of  25.6  to  74.4  minutes. 

Subjects  proceeded  at  their  own  pace,  and  could  call  the 
experimenter  if  they  encountered  problems.  The  experimenter 
would  intervene  when  called  on  for  assistance  by  the  subject, 
or  when  the  svibject  had  spent  at  least  5  minutes  on  a  problem 
and  was  making  no  apparent  progress  in  resolving  it.  An 
attempt  was  made  to  keep  interventions  to  a  minimum. 

2.  Data  Collection  Sessions 

After  completing  the  practice  session  successfully,  the 
subject  was  instructed  to  notify  the  experimfenter  before 
proceeding.  The  experimenter  then  replaced  the  instruction 
set  with  information  eibout  the  simple  task  set  that  was  to  be 
completed  next.  The  complete  file  system  was  changed  at  this 
time  to  include  a  new  set  of  directories  and  files,  as 
required  for  the  data  trials.  The  subjects  were  instructed 
and  encouraged  to  use  the  on-line  help  and  directory  tree  as 
needed.  Error  messages  also  were  provided.  The  error 
messages  on  both  interfaces  described  what  caused  the  error, 
but  not  necessarily  how  to  correct  the  error. 
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After  completing  the  simple  task  set,  the  experimenter 
was  again  notified  so  the  computer  files  and  interface  could 
be  prepared  for  the  complex  task  set.  A  new  directory  and 
file  structure  was  installed  and  the  sxabject  was  instructed  to 
proceed  with  the  set  of  five  complex  tasks. 

3.  Post -Test  Data  Collection 

After  completing  the  complex  task  set,  each  svibject 
answered  a  series  of  questions  to  obtain  their  opinions  cibout 
the  operating  system  interface  used  in  the  experiment. 
Questions  also  were  asked  edsout  operating  system  experience, 
and  experience  with  typing  (CLI)  or  a  mouse  (DMI) .  Some 
personal  data  also  was  collected.  This  questionnaire  is 
included  in  Appendices  B  and  D. 

Each  subject  rated  the  ease  of  use  of  the  interface  he  or 
she  had  used  on  a  scale  of  1-9  with  1  being  "not  at  all  easy" 
and  9  being  "very  easy."  The  ease  of  learning  the  interface 
also  was  ranked  on  a  scale  of  1-9  with  1  being  "not  at  all 
easy"  and  9  being  "very  easy."  The  helpfulness  of  the  error 
messages  were  ranked  on  a  scale  of  1-9  with  1  being  "not  at 
all  helpful"  and  9  being  "very  helpful."  The  svibject s  were 
asked  to  rank  their  progress  on  the  interface  on  a  scale  of  1- 
9  with  1  being  "not  at  all  rapid"  and  9  being  "very  rapid. " 

The  svibject  was  asked  to  predict  his  or  her  percent 
accuracy  and  to  estimate  the  nvimber  of  errors  that  occurred. 
Question  6  asked  if  at  any  time  during  the  experiment  the 
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interface  appeared  so  difficult  that  he  or  she  was  ready  to 
eibandon  the  experiment . 

The  subject  was  also  asked  to  rank  his/her  experience 
with  computers  prior  to  the  experiment .  This  was  also  ranked 
on  a  scale  of  1-9  with  1  being  "no  experience"  and  9  being 
"very  experienced. "  If  the  subject  reported  an  experience 
level  of  2  or  greater  on  this  question,  he  or  she  was  asked  to 
report  the  type  of  operating  system  experience  (DOS,  UNIX, 
Apple /Macintosh,  VAX,  or  other) .  This  information  was  used  to 
determine  the  subject's  level  of  procedural  knowledge 
concerning  operating  systems.  To  confirm  the  user's  level  of 
experience  with  operating  systems,  an  additional  nine 
questions  were  asked  to  test  objectively  the  user's  level  of 
capability. 

The  subject  was  then  asked  to  rank  typing  experience  for 
the  CLI  or  mouse  experience  with  DMI  on  a  scale  of  1-9  with  1 
being  "no  experience"  and  9  being  "very  experienced."  They 
concluded  by  providing  demographic  data  including  age,  sex, 
undergraduate  degree,  NPS  Curriculxjm,  and  years  of  computer 
experience . 

I.  DATA  COLLECTION  PROCEDURE 

A  user  log  was  maintained  for  each  subject,  automatically 
recording  total  response  time  and  actions  performed  by  the 
subject  for  each  task  session.  The  user  log  was  then 
converted  to  summarize  all  times  required  to  coir^lete  each 
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task  set,  operations  completed,  and  errors  that  occurred. 
Appendix  E  is  an  example  of  a  user  log  for  a  CLI  trial  and 
Appendix  F  is  a  sample  of  a  DMI  trial  user  log. 

All  possible  operations  and  errors  were  defined  and  coded 
for  both  interfaces  prior  to  the  experimental  runs.  Appendix 
G  and  H  siommarize  the  codes  for  CLI  and  DMI  respectively.  If 
an  operation  was  performed  correctly  (i.e.,  there  were  no 
typing  errors  in  the  command  for  a  CLI  trial  and  all  required 
steps  were  completed  for  a  DMI  trial) ,  the  response  time  and 
type  of  operation  (including  file  and  directory  neunes)  were 
recorded.  If  an  error  occurred,  the  time  it  occurred, 
operation  code,  and  a  description  of  the  error  were  recorded. 
This  log  permitted  tracking  the  user's  progress  and  verifying 
all  operations. 

In  a  few  instances  it  was  possible  for  the  subject  to 
perform  the  task  incorrectly,  yet  have  it  recorded  as  a 
correct  operation  (e.g.,  misspell  the  new  file  name  or  create 
a  file  in  the  wrong  directory)  .  For  this  reason  all  user  logs 
were  reviewed  manually.  Errors  noted  during  the  manual  review 
were  included  in  the  analysis  and  classified  as  missing  or 
incorrect  operations.  Additionally,  unnecessary  operations 
were  noted. 
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IV.  RESULTS 


A.  DATA  ANALYSIS 

The  data  was  analyzed  using  a  multivariate  analysis  of 
variance  for  repeated  measures  to  determine  the 
interrelationships  of  the  dependent  varieibles:  task  completion 
time,  number  of  errors,  emd  number  of  times  help  screens  were 
referred  to.  The  model  for  analysis  was  derived  from  Winer 
[Ref  14:pp.  630-633].  Additionally,  a  univariate  analysis  was 
conducted  on  each  dependent  varied:>le. 

After  reviewing  the  data,  it  was  determined  that  two  of 
the  DMI  subject  data  sets  were  outliers,  and  were  dropped  from 
the  data  analysis.  As  a  result  of  the  unec[ual  number  of 
siibjects  evaluated  under  each  condition  (13  CLI  and  12  DMI) , 
the  emalysis  was  conducted  using  the  General  Linear  Models 
Procedure  of  the  SAS  statistical  software  program  [Ref  15:pp. 
555-556] . 

B .  EXPERIMENTAL  RESULTS 

Summary  statistics  (means  and  standard  deviations)  for 
each  of  the  three  dependent  variables  are  given  in  Table  2 . 
The  mean  values  for  these  varicJDles  are  plotted  as  a  function 
of  interfaces  and  task  types  in  Figures  20  through  22.  The 
graphs  indicate  that,  as  the  task  complexity  increases. 
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individuals  using  a  CL  interface  will  require  more  time  to 
complete  their  tasks ,  will  make  more  errors,  and  will  refer  to 
on-line  help  screens  more  often.  When  a  DM  interface  is  used, 
time  to  complete  simple  tasks  is  approximately  the  same  as  the 
time  for  the  CL  interface  and  remains  low  for  the  complex  task 
set.  The  number  of  errors  begins  and  remains  low,  while 
references  to  the  help  function  are  high  during  practice,  but 
drop  sharply  as  the  simple  and  complex  tasks  are  carried  out. 


TABLE  2 

SUMMARY  OF  RESULTS 
MEANS 

(STANDARD  DEVIATIONS) 


Dependent 

Variables 

Interface  Type 

CLI 

DMI 

Practlc* 

Session 

Simple 

Task 

Complex 

Task 

Practice 

Session 

Simple 

Task 

Complex 

Task 

Completion 
Time,  Min 

9.93 

(3.60) 

9.78 

(6.38) 

43.56 

(9.39) 

42.53 

(14.68) 

6.82 

(3.03) 

16.82 

(4.01) 

Number  of 
Errors 

1.15 

(1.14) 

2.46 

(2.54) 

16.08 

(6.40) 

3.00 

(2.30) 

1.92 

(1.50) 

4.25 

(2.80) 

Number  of 
Help 

References 

1.61 

(0,65) 

3.77 

(3.92) 

9.92 

(4.42) 

6.33 

(4.05) 

1.08 

(1.56) 

2.42 

(2.06) 

57 
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Figure  20  Mean  Values  for  Task  Completion  Time,  as  a  function 
of  Interface  Type  and  Task  Type. 
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Figure  21 


Mean  Values  for  Number  of  Errors,  as  a  Function 
of  Interface  Type  and  Task  Type. 
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Figure  22  Mean  Values  for  Number  of  Help  References,  as 
a  Function  of  Interface  Type  and  Task  Type. 
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1. 


Task  Conpletion  Time 


TeJDle  3  siinunarizes  the  results  of  a  multivariate  analysis 
of  variance  for  the  dependent  variable  completion  time.  No 
significant  difference  was  observed  in  task  completion  time  as 
a  function  of  the  type  of  interface  (CLI  or  DMI) .  There  was 
a  significant  difference  at  the  0.0001  level  between  the  tasks 
(simple  or  complex) .  The  interaction  between  interface  type 
and  task  completion  time  was  significant  at  the  0.0001  level. 


TABLE  3 

MULTIVARIATE  ANALYSIS  OF  VARIANCE  FOR 
THE  DEPENDENT  VARIABLE  COMPLETION  TIME 


Source  of  Variation 

d.f . 

F 

SIG  (F) 

Intarfaca  Typa 

1 

0.18 

0.6748 

Subjacta  within 
Groupa 

23 

Taak  Typa 

2,  22 

214.30 

0.0001 

Taak  x 

Intarfaca  Typa 

2,  22 

73.99 

0.0001 

Univariate  analysis  of  variance  tests  were  carried  out  to 
determine  the  direction  of  the  interactive  interface-task 
effects,  and  results  were  confirmed  using  Scheffe's  test.  As 
seen  in  Tcible  4,  the  time  required  to  learn  to  use  the  DMI  was 
significantly  greater  than  the  time  to  learn  CLI  at  the  0.0001 
level.  This  supports  hypothesis  Hi*,  as  discussed  in  Chapter 
III. 
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TABLE  4 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR 
COMPLETION  TIME  FOR  PRACTICE  SESSIONS 


Source  of  variation 

d.f . 

F 

SIG  (F) 

Typa  of  Intarfaca 

1 

60.42 

0.0001 

Subjact  within  group 

23 

No  significant  difference  in  completion  time  was  observed 
between  the  two  interfaces  for  the  simple  task  set  (Tedale  5)  . 
This  supports  hypothesis  Hib- 


TABLE  5 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR 
COMPLETION  TIME  FOR  SIMPLE  TASK  SET 


Sourca  of  variation 

d.f. 

F 

SIG  (F) 

Typa  of  Intarfaca 

1 

1.83 

0.1893 

Subjact  within  Group 

23 

As  Table  6  indicates,  the  time  required  to  complete  the 
complex  task  set  using  the  CLI  is  significantly  greater  than 
task  completion  time  using  the  DMI  (p<0.0001).  This  finding 
supports  hypothesis  Hic* 
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TABLE  6 

ONrVARIATB  ANALYSIS  OF  VARIANCE  FOR  COMPLETION 
TIME  FOR  COMPLEX  TASK  SET 


Source  of  variation 

d.f . 

F 

SIG  (F) 

Type  of  Interface 

1 

83.09 

0.0001 

Subject  within  Group 

23 

2.  Number  of  Errors 

Table  7  sxumnarizes  results  of  a  multivariate  analysis  of 
variance  for  the  dependent  variable  number  of  errors. 
Performance  results  for  the  two  interface  types  were 
significantly  different  at  the  0.002  level.  Errors  also  were 
significantly  different  as  a  function  of  task  type  (p<0.0001)  , 
and  the  interaction  between  interface  type  (CLI  and  DMI)  and 
task  type  (simple  and  complex)  also  was  significant  at  the 
0.0001  level. 

Univariate  analysis  of  variance  tests  were  also  carried 
out  on  the  results  for  the  error  variable,  and  confirmed  using 
Scheffe's  test.  The  number  of  errors  that  occurred  during  the 
practice  session  approached  significance  for  subjects  using 
the  DMI,  when  compared  with  those  using  the  CLI  (p<0.02). 
This  is  shown  in  Table  8,  and  supports  hypothesis 
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TABLE  7 

MULTIVARIATE  ANALYSIS  OF  VARIANCE  FOR  THE 
DEPENDENT  VARIABLE  NUMBER  OF  ERRORS 


Sourc#  of  Variation 

d.f . 

F 

SIG  (F) 

Intorfaco  Typ# 

1 

12.19 

0.0020 

Subjacts  within 
Group 

23 

Task  Typa 

CM 

CM 

CM 

48.95 

0.0001 

Task  X 

Intarfaca  Typa 

2,  22 

25.66 

0.0001 

TABLE  8 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR  NUMBER  OF 
ERRORS,  FOR  PRACTICE  SESSIONS 


Sourca  of  variation 

ci.f . 

F 

SIG  (F) 

Typa  of  Intarfaca 

1 

6.64 

0.0169 

Subjact  within  Group 

23 

No  significant  difference  was  observed  in  the  nvimber  of 
errors  generated  by  siabjects  using  the  two  interfaces  for  the 
simple  task  set,  as  shown  in  Table  9.  This  supports 
hypothesis  Hjb- 

As  seen  in  Table  10,  the  niomber  of  errors  that  occurred 
during  completion  of  the  complex  task  set  was  significantly 
greater  for  those  using  the  CLI  (p<0.0001).  This  finding 
supports  hypothesis  Hjc. 
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TABLE  9 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR  NUMBER  OF 
ERRORS,  FOR  SIMPLE  TASK  SET 


Source  of  variation 

d.f. 

F 

SIG  (F) 

Type  of  Interface 

1 

0.42 

0.5248 

Subject  within  Group 

23 

TABLE  10 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR  NUMBER  OF 
ERRORS,  FOR  COMPLEX  TASK  SET 


Source  of  variation 

d.f. 

F 

SIG  (F) 

Type  of  Interface 

1 

34.78 

0.0001 

Subject  within  Group 

23 

3 .  Help  References 

TeJ:>le  11  sxjimnarizes  the  results  of  a  multivariate 
analysis  of  variance  for  the  dependent  varicJ^le  niimber  of  help 
references .  Results  approached  significance  for  interface 
type  (p<0.05).  Statistical  significance  at  the  0.0001  level 
was  observed  both  for  type  of  task  and  for  the  task  type  x 
interface  type  interaction. 
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TABLE  11 

MULTIVARIATE  ANALYSIS  OF  VARIANCE  FOR  THE 
NUMBER  OF  HELP  HEFEIRENCES 


Source  of  Variation 

d.f . 

F 

SIG  (F) 

Intarfaca  Typa 

1 

4.51 

0.0447 

Stibjacta  within 
Group 

23 

Taak  Typa 

2,  22 

17.14 

0.0001 

Taak  x 

Intarfaca  Typa 

2,  22 

21.31 

0.0001 

Ted>le  12  provides  univariate  analysis  of  variance  results 
for  the  number  of  times  that  help  was  referenced  during  the 
practice  session.  As  may  be  observed,  differences  in  results 
between  siibjects  using  the  two  interface  types  was  significant 
at  the  0.0004  level.  This  supports  hypothesis  Hj^r  that  DMI 
help  references  will  be  greater  than  CLI  help  rerferences. 


TABLE  12 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR  NUMBER  OF 
HELP  REFERENCES  DURING  PRACTICE  SESSIONS 


Sourca  of  variation 

d.f. 

F 

SIG  (F) 

Typa  of  Intarfaca 

1 

17.20 

0.0004 

Subjact  within  Group 

23 
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Table  13  shows  the  univariate  analysis  results  for  the 
nvunber  of  times  that  help  was  referenced  during  completion  of 
the  simple  task  set.  Significance  was  approached  (p<0.05), 
but  not  conclusive.  Thus  H3B  is  supported. 


TABLE  13 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR  NUMBER  OF 
HELP  REFERENCES  DURING  SIMPLE  TASK  SET 


Source  of  variation 

d.f. 

F 

SI6  (F) 

Type  of  Interface 

1 

4.90 

0.0370 

Subject  within  Group 

23 

Analysis  of  the  number  of  times  that  help  was  referenced 
during  completion  of  the  complex  task  set  is  provided  in  Tcible 
14.  References  by  those  using  the  CL  interface  were 
significantly  greater  than  the  number  of  references  by  DMI 
users  (p<0.0001).  This  supports  hypothesis  Ha^. 

TABLE  14 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR  THE  NUMBER  OF 
HELP  REFERENCES  DURING  COMPLEX  TASK  SET 


Source  of  variation 

d.f. 

F 

SIG  <F) 

Type  of  Interface 

1 

28.69 

0.0001 

Subject  within  Group 

23 
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Table  15  summarizes  the  posterior  test  results  produced 
using  Scheffe's  test.  The  difference  of  the  means  were 
significantly  different  for  all  three  dependent  variedDles  for 
the  practice  session  and  complex  task  set,  and  not 
significantly  different  for  the  simple  task  set.  The  same 
results  were  obtained  using  Tukey's  posterior  test. 


TABLE  15 

SUMMARY  OF  SCHEFFE'S  POSTERIOR  TEST 


Dependent 

Varied>le 

Practice 

Simple 

Complex 

1  Completion 
Time 

Significant 

Not 

Significant 

Significant 

Number  of 
Errors 

Significant 

Not 

Significant 

Significant 

Number  of 
Help 

References 

Significant 

Significant 

Significant 

Legend! 


Significant : Difference  of  means  between  two 
groups  is  significant  at  alpha=0.05. 

Not  Significant:  Difference  of  means  between  two 
Groups  is  not  significant  at  alpha=0.05. 


C .  SUBJECT  RESPONSES 

Participants  in  this  study  were  asked  to  respond  to  the 
following  questions,  rating  the  interface  used  on  a  linear 
scale  of  1  to  9. 
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1 .  How  easy  was  this  interface  to  use? 

2 .  How  easy  was  this  interface  to  learn? 

3.  To  what  extent  were  the  error  messages  helpful? 

4.  How  rapidly  did  you  progress  through  this  experiment? 
Results  were  averaged,  and  are  provided  as  Figure  23.  It 
should  be  noted  that  the  subjects  who  used  the  DM  interface 
perceived  that  interface  to  be  easier  to  use  and  their 
progress  more  rapid  than  did  those  who  used  the  CL  interface. 
Table  16  svunmarizes  the  two-tailed  T  test  which  was  conducted 
to  determine  the  level  of  user  agreement  across  the  two 
groups.  The  t-value  indicates  that  the  subject  responses  are 
not  significantly  different  between  the  two  groups. 


Figure  23  User  Ratings  of  the  CL  and  DM  Interfaces,  for 
Four  Variables . 
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TABLE  16 

RESULTS  OF  TWO— TAILED  T— TEST 
FOR  SUBJECT  RESPONSES 
df=23,  critical  value  =  ±  2.069 
at  the  5%  significance  level 


Question 

Interface 

Mean 

Standard 

Deviation 

t -value 

Ease  of 
Use 

CLI 

6.69 

1.182 

1.20 

DMI 

7.58 

2.275 

Ease  of 
Learning 

CLI 

7.46 

1.266 

0.41 

DMI 

7.17 

2.125 

Error 

Messages 

Helpful 

CLI 

6.38 

1.850 

-  0.74 

DMI 

6.3t 

1.782 

Rapid 

Progress 

CLI 

5.38 

2.219 

-  1.24 

DMI 

6.50 

2.276 

D.  PROCESS  AND  MANIPULATION  CHECKS 

Teible  17  summarizes  the  univariate  analysis  for  the  WQ. 
The  mean  for  the  CLI  subjects  was  7.6  with  a  standard 
deviation  of  1.8.  The  mean  for  the  DMI  subjects  was  7.75  with 
a  standard  deviation  of  2.4.  No  significant  difference  was 
observed  in  the  WQ  for  the  svibjects  using  the  two  interfaces. 
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TABLE  17 

UNIVARIATE  ANALYSIS  OF  VARIANCE  FOR 
VISUAL  VERSUS  VERBAL  METHODS  OF  THINKING 


Source  of  Variation 

d.f . 

F  Value 

SIG  (F) 

Tyi>e  of  Interface 

1 

0.03 

0.8753 

Subject  within  Group 

23 

The  number  of  svibjects  who  contemplated  abandoning  the 
experiment  was  not  different  between  the  two  interfaces. 
However,  the  point  at  which  the  subjects  considered  abandoning 
the  experiment  was  meaningful.  Three  individuals  using  the 
CLI  reported  that  they  considered  abandoning  the  experiment 
during  the  complex  task  session.  All  three  reported  that  the 
steps  needed  to  locate  the  largest  file  were  too  time 
consuming.  This  is  supportive  of  hypothesis  that  time  to 
complete  the  complex  task  set  using  the  CLI  would  be  greater 
than  with  the  DMI . 

Two  subjects  assigned  to  the  DMI  condition  reported  that 
they  considered  abandoning  the  experiment  during  the  practice 
session.  Both  found  that  learning  the  intricacies  of  the 
interface  was  difficult.  This  supports  hypothesis  that 
the  DMI  interface  would  prove  to  be  difficult  to  learn. 

Of  the  25  subjects,  14  indicated  that  they  had  some 
experience  with  DOS  computer  system,  four  had  experience  with 
Apple/Macintosh  systems,  and  five  reported  experience  with 
"other"  operating  systems.  A  closer  review  of  the  "other" 
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category  indicated  that  these  subjects  were  uncertain  as  to 
the  meaning  of  operating  system,  and  mistakenly  reported 
experience  with  DOS  shells  or  various  application  programs. 

Those  with  operating  system  experience  were  asked  to 
complete  a  short  quiz  (contained  in  Appendices  A  and  C) .  An 
average  of  less  than  9%  of  the  follow-on  operating  system 
questions  were  answered  correctly  by  those  who  claimed  to  have 
some  operating  system  experience.  Thus,  the  assumption  that 
the  sxobjects  had  little  or  no  operating  system  experience 
appeared  to  be  valid. 

The  average  age  of  subjects  in  the  two  groups  was 
essentially  the  Scune  (31.4  years  for  CLI  and  31.5  years  for 
DMI)  .  Therefore,  age  was  not  a  determining  factor  for 
performance  on  either  interface. 
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V.  CONCLUSIONS  AND  RECOMMENDATIONS 


A.  GOAL 

The  goal  of  this  study  was  to  determine  if  the  user  will 
benefit  from  the  use  of  a  DM  interface  over  a  CL  interface  for 
simple  and  complex  tasks. 


B .  HYPOTHESES 

The  hypotheses  listed  below  were  supported  or  rejected 
using  four  statistical  tests,  multivariate  analysis  of 
variance,  univariate  analysis  of  variance,  Scheffe' s  posterior 
test,  and  Tukey' s  posterior  test; 

•  Hypothesis  1 :  Coxi^letion  Time 

Hj*  The  time  required  to  learn  how  to  carry  out  the 
tasks  and  to  complete  the  practice  session  will  be 
significantly  greater  for  the  DM  interface  than  the 
time  required  to  learn  and  complete  the  practice 
session  using  the  CL  interface.  This  hypothesis  was 
supported  by  all  four  statistical  tests. 

Hib  The  time  required  to  complete  the  simple  task  set 
will  not  be  significantly  different  between  the  two 
interfaces.  This  was  supported  by  all  four 
statistical  tests. 

Hjc  The  time  required  to  complete  the  complex  task  set 
using  the  CLI  will  be  significantly  greater  than  the 
time  required  to  complete  the  complex  task  set  using 
the  DMI.  This  was  supported  by  all  four  statistical 
tests . 

•  Hypothesis  2 :  Number  of  Errors 

The  number  of  errors  that  occur  during  the  practice 
session  will  be  significantly  greater  while  using 
the  DMI  than  the  nxamber  of  errors  measured  while 
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using  the  CLI .  This  was  supported  by  all  four 
statistical  tests. 

Hjb  The  number  of  errors  that  occur  while  completing  the 
simple  task  set  will  not  be  significantly  different 
between  the  two  interfaces.  This  was  supported  by 
all  four  statistical  tests. 

Hjc  The  number  of  errors  that  occur  while  completing  the 
complex  task  set  will  be  significantly  greater  while 
using  the  CLI  than  the  niamber  of  errors  measured 
while  using  the  DMI .  This  was  supported  by  all  four 
statistical  tests. 

•  Hypothesis  3:  Number  of  Help  References 

The  nximber  of  times  the  help  screen  is  referenced 
during  the  practice  session  will  be  significantly 
greater  for  the  DMI  condition  than  the  number  of 
times  the  help  screen  is  referenced  for  the  CLI 
condition.  This  was  supported  by  all  four 

statistical  tests. 

Hjb  The  n\2mber  of  times  the  help  screen  is  referenced 
during  the  simple  task  set  will  not  be  significantly 
different  for  the  DMI  condition  than  for  the  CLI 
condition.  This  was  supported  by  all  four 

statistical  tests. 

Hgc  The  number  of  times  the  help  screen  is  referenced 
during  the  complex  task  set  will  be  significantly 
greater  while  using  the  CLI  than  the  number  of  times 
the  help  screen  is  referenced  while  using  the  DMI. 
This  was  supported  by  all  four  statistical  tests. 


C.  CONCLUSIONS  OP  STUDY 

This  study  has  demonstrated  that  learning  to  use  a  DM 
interface  is  more  time  consuming  than  learning  to  use  a  CL 
interface.  However,  once  it  is  learned,  a  novice  can  be 
productive  in  carrying  out  complex  tasks,  as  well  as,  simple 
ones.  The  productivity  of  those  using  a  CL  interface  appears 
to  be  reduced  as  the  complexity  of  the  task  is  increased. 
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That  is,  the  time  required  to  complete  the  task  is  increased, 
more  errors  are  generated,  and  the  number  of  references  to 
help  screens  increases. 

Users  also  perceive  the  DM  interface  to  be  harder  to 
learn,  yet  easier  to  use.  Additionally,  the  users  of  the  DM 
interface  perceive  the  error  messages  to  be  more  helpful  and 
progressed  more  rapidly  through  the  experiment. 

This  study  explored  the  relative  benefits  of  DM 
interfaces  and  CL  interfaces.  Essentially,  for  simple  tasks, 
neither  interface  has  a  clear  advantage.  However,  as  the 
complexity  of  the  task  is  increased,  DM  interfaces  appear  to 
help  novices  to  be  more  productive  than  do  CL  interfaces. 

D.  LIMITATIONS  AND  FURTHER  RESEARCH 

Several  follow-on  studies  are  suggested  by  the  results 
provided  here.  First,  to  determine  the  level  of  task 
complexity  at  which  a  DM  interface  is  more  advantageous,  a 
similar  experiment  could  be  conducted  using  several  levels  of 
task  complexity  instead  of  two.  Second,  user  interface 
complexity  (as  discussed  in  Chapters  I  and  II)  should  be 
considered.  This  form  of  complexity  might  be  increased  by 
providing  more  than  one  way  to  complete  a  given  task. 

Third,  similar  experiments  could  be  conducted  to 
determine  relative  CL  and  DM  interface  usefulness  for  other 
areas  of  computer  applications  such  as  word  processing  and 
data  processing.  The  number  of  subjects  tested  should  be 


75 


increased  for  such  studies  and  should  be  representative  of 
those  likely  to  utilize  such  applications,  i.e.,  clerical 
personnel . 

Fourth,  verbal  protocol  technic[ues  could  be  used  during 
conduct  of  similar  interface  experiments .  These  techniques 
aid  in  modeling  the  users'  thought  processes,  providing  useful 
information  related  to  completing  tasks. 

Fifth,  this  study  compared  the  productivity  of  persons 
using  an  icon-based  DM  interface  to  that  of  those  using  a  CL 
interface.  Other  research  could  include  comparisons  of  menu- 
based  interfaces  to  icon  or  CL-based  interfaces.  This  would 
determine  which  form  of  DM  would  be  more  productive. 

Sixth,  another  area  of  research  might  include  comparing 
novices  and  experts  in  either  one  or  all  of  the  suggested 
areas  2dDove.  Such  research  would  aid  progrcim  developers  in 
deciding  which  interface (s)  to  include  in  an  application 
program  for  their  typical  users. 
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APPENDIX  A 


DEFINITIONS 


Cognitive  complexity;  complexity  dependent  on  the  amount, 

content  and  structure  of  the  knowledge  required  to 
operate  a  device  or  system  [Ref  3;p.  364-365] . 

Cognitive  Complexity  approach;  work  based  on  the  hypothesis 
that  content,  structure,  and  eunount  of  knowledge  required 
to  perform  a  task  on  a  system  determines  training  time 
and  productivity  [Ref  2;p.  366]. 

Cognitive  system;  the  human  system  that  provides  the  eibility 
to  move  symbolic  information  obtained  from  the  sensory 
image  stores  to  working  memory,  where  it  is  combined  with 
information  previously  stored  in  long-term  memory  [Ref 
l;p.  24]  . 

Command  language  (CL)  interface;  an  interface  that 

requires  the  user  to  communicate  with  the  computer  by 
typing  a  formal  language  with  specific  syntax  [Ref  6;p. 
154]  . 

Complexity;  the  number  of  goals  and  processes  that  must  be 

controlled,  and  the  characteristics  of  the  means 
available  for  this  control  [Ref  10;p.  24];  the  level  of 
complexity  is  determined  by  the  difficulty  of  acquiring 
the  new  knowledge  necessary  to  operate  a  device 
successfully  [Ref  2;p.  366]  . 

Component  complexity  of  a  task:  complexity  that  is  a  direct 
function  of  (1)  the  nvimber  of  distinct  acts  that  must  be 
executed  in  the  performance  of  the  task  and  (2)  the 
number  of  distinct  information  cues  that  must  be 
processed  in  the  performance  of  those  acts  [Ref  6;p.  66- 
67]  . 

Coordinative  complexity;  complexity  due  to  the  nature  of 

relationships  between  task  inputs  and  task  products  [Ref 

6;p.  68] . 

Declarative  knowledge:  knowledge  of  facts  [Ref  3;p.  369] . 

Device  complexity;  the  level  of  complexity  of  the  knowledge 
representations  required  to  operate  a  given  device  [Ref 
2 :  p .  367] . 
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Device  representation:  the  knowledge  that  a  user  has  about  the 
device  itself  [Ref  2:p.  366]. 

Direction:  a  specific  kind  of  activity  or  process  carried  out 
when  an  act  is  performed  [Ref  6:p.  65] . 

Direct  manipulation  (DM)  interface:  an  interface  that  presents 
a  set  of  visual  representations  on  a  display  and  provides 
a  repertoire  of  manipulations  that  can  be  performed  on 
any  of  them  [Ref  ll:p.  283]. 

Dynamic  complexity:  changes  in  the  states  of  the  world  which 
have  an  effect  on  the  relationships  between  task  inputs 
and  products  [Ref  6:p.  71-73]. 

GOMS  model:  a  descriptive  model  that  describes  a  user's  task 
representation  using  goals,  operations,  methods,  and 
selection  rules  [Ref  l:p.  139-144]. 

Human-computer  interface:  the  dialogue  that  occurs  between  a 
user  and  a  computer  to  accon^lish  a  specific  task  [Ref 
l:p.  23] . 

Icons:  graphical  representations  of  the  objects  or  actions 
that  are  part  of  a  direct  manipulation  interface  [Ref 
12:p.  105]. 

Information  cues:  pieces  of  information  about  the  attributes 
of  stimulus  objects  [Ref  6:p.  65] . 

Motor  system:  the  human  system  that  carries  out  the  responses 
of  the  perceptual  and  cognitive  systems  [Ref  l:p.  34]. 

Perceptual  system:  the  human  system  that  carries  sensations  of 
the  physical  world  detected  by  the  body's  sensory  systems 
into  internal  representations  of  the  mind  by  means  of 
integrated  sensory  systems  (Ref  l:p.  25-34]. 

Production  rule:  a  statement  about  the  external  environment  or 
the  contents  of  working  memory  [Ref  4:p.  7]. 

Production  system:  a  formal  notation  used  to  represent  the 

user's  knowledge  of  the  job-task  environment,  which  is 
composed  of  production  rules  and  working  memory  [Ref  2:p. 
368]  . 

Required  acts:  human  acts  that  include  a  pattern  of  behaviors 
with  some  purpose  or  direction  [Ref  6:p.  64]. 

Task  complexity:  the  measurable  complexity  of  the  task  that  is 
being  performed  [Ref  6:p.  66]. 
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Task  products;  entities  that  are  created  or  produced  by 

behaviors  that  can  be  observed  and  described 
independently  of  the  behaviors  or  acts  that  produce  them 
[Ref  6:p.  64] . 

Task  representation:  a  user's  knowledge  of  how  to  carry  out  a 
task  using  a  given  device  [Ref  2:p.  366]. 

User  interface  complexity:  the  complexity  of  a  device  or 

system  from  the  point  of  view  of  the  user  [Ref  2:p.  365]  . 

Working  memory;  the  part  of  memory  that  contains 

representations  of  current  goals  and  inputs  from  the 
environment  and  other  information  about  the  state  of 
current  and  past  actions  [Ref  4:p.  6]. 
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APPENDIX  B 


COMMAND  LANGUAGE  INTERFACE 


YOUR  NAME :  _ 

SMC  NO :  _ 

I .  INTRODUCTION 

The  exercise  you  are  about  to  participate  in  involves 
operating  and  evaluating  a  recently-developed  computer  file 
management  system.  You  will  be  asked  to  read  a  short 
description  of  file  management,  followed  by  instructions  for 
each  file  management  operation.  You  will  then  practice  each 
operation  until  you  can  perform  the  operation  successfully. 
Upon  completing  all  the  operations  successfully,  you  will  do 
a  series  of  tasks  that  involve  using  the  operations  you  have 
learned. 


PRIVACY  ACT 

The  information  accompanying  this  experiment  will  be  used  for 
data  collection  and  correlation  purposes  only.  Information 
provided  is  voluntary. 
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II .  QUESTIONNAIRE 


INSTRUCTIONS: 

Please  place  a  T(true)  or  F  (false)  next  to  each  of  the 

following  statements  as  you  feel  it  best  applies  to  you. 

_  1.  I  enjoy  doing  work  that  requires  the  use  of  words. 

_  2 .  My  daydreams  are  sometimes  so  vivid  I  feel  as  though 

I  actually  experience  the  scene. 

_  3.  I  enjoy  learning  new  words. 

_  4 .  I  can  easily  think  of  synonyms  for  words . 

_  5.  My  powers  of  imagination  are  higher  than  average. 

_  6.  I  seldom  dream. 

_  7.  I  read  rather  slowly. 

_  8.  I  cannot  generate  a  mental  picture  of  a  friend's 

face  when  I  close  my  eyes . 

_  9.  I  don't  believe  that  anyone  can  think  in  terms  of 

mental  pictures. 

_  10.  I  prefer  to  read  instructions  about*  how  to  do 

something  rather  than  have  someone  show  me. 

_  11.  My  dreams  are  sometimes  vivid. 

_  12.  I  have  better  than  average  fluency  in  using  words. 

_  13.  My  daydreams  are  rather  indistinct  and  hazy. 

_  14.  I  spend  very  little  time  attempting  to  increase  my 

vocabulary. 

_  15.  My  thinking  often  consists  of  mental  pictures  or 

images . 
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III.  FILE  MANAGEMENT  SYSTEM 


A.  OPERATING  SYSTEM 

An  operating  system  is  the  software  progreun  that  makes 
the  hardware  useable.  The  operating  system  can  accomplish 
many  functions  such  as  communicating  between  the  user  and  the 
computer  (known  as  the  user  interface)  ,  sharing  hardware  cimong 
users,  allowing  users  to  share  data  among  themselves,  and  many 
other  functions. 

An  operating  system' s  primary  duty  is  to  manage  various 
files.  Before  we  go  into  the  details  of  files,  it  is 
important  to  understand  the  structure  and  organization  of 
files. 

B.  DIRECTORIES  AND  FILES 

A  software  program  usually  consists  of  several  files. 
These  files  work  together  to  produce  the  program  that  the  user 
sees  and  interacts  with  on  the  screen.  A  directory  contains 
all  of  the  files  used  for  a  given  progreun.  For  instance,  all 
the  files  that  operate  the  popular  word  processing  program, 
WordPerfect  5.1,  might  be  located  in  a  directory  called  WP51. 
It  is  also  possible  (and  highly  recommended)  to  have 
sxabdirectories  within  a  directory  to  segregate  your  files 
further.  For  instance,  in  the  WP51  directory  you  might  have 
a  subdirectory  titled  WORK  for  all  the  files  relating  to  your 
work  and  one  titled  THESIS  for  all  the  files  relating  to  your 
thesis . 
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Figure  1  shows  the  relationship  of  this  WP51  directory  to 
its  subdirectories  and  files ^  and  also  its  relationship  with 
the  top-level  Root  directory,  often  represented  by  a  slash 
(\) .  Two  other  directories  at  the  same  level  as  WP51  (here 
called  DOS  and  HG)  also  are  shown,  along  with  their  files . 


SUBDIRECTORY 


DIRECTORY  _  FILES 


Figure  1 .  Relationships  of  the  WP51  Directory 
with  other  Directories  emd  Files. 


It  is  often  necessary  to  copy  or  move  a  file  from  one 
directory  to  another.  The  operating  system  must  provide 
methods  to  move  these  files.  For  excimple,  suppose  you  wrote 
a  paper  for  a  National  Security  class  titled  The  Middle  East 
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and  stored  this  file  in  the  WORK  directory  under  WP51.  Later 
in  the  year  you  decide  to  use  this  paper  in  your  thesis  and 
need  to  transfer  the  file  to  the  THESIS  subdirectory.  Some 
form  of  move  or  copy  commemd  would  allow  you  to  transfer  this 
file.  Additionally,  you  may  want  to  change  the  file  neune  to 
Chapter  II .  Again  the  operating  system  interface  must  provide 
a  means  of  doing  so. 

As  mentioned  earlier,  directories  contain  related  files. 
The  operating  system  interface  also  must  provide  a  means  to 
manage  directories.  That  is,  commands  such  as  create 
directory  and  delete  directory  are  needed. 


IV.  OPERATING  SYSTEM  INTERFACE 

The  experimental  operating  system  interface  you  will  be 
working  with  is  a  Command  Language  Interface,  Figure  2.  It 
uses  specific  commands  to  perform  an  operation.  The  interface 
contains  three  windows:  Directory,  File,  and  Command  windows. 

A.  WINDOWS 

1 .  Directory  Window 

The  Directory  Window  provides  a  directory  tree  of  all  the 
subdirectories  contained  in  a  specified  directory.  If 
insufficient  space  is  provided  in  the  window  for  the  entire 
directory  tree,  the  user  will  be  prompted  to  press  M  for  the 
remainder  of  the  tree. 
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2.  File  Window 


The  File  Window  contains  a  listing  of  all  the  files  in  a 
specified  directory.  The  name  of  the  directory  appears  in  the 
Icibel  for  the  File  Window.  If  insufficient  space  is  provided 
in  the  window  for  all  the  files,  the  user  will  be  prompted  to 
press  M  for  additional  files. 


DIRECTORY  WINDOW 


WORK 


E 


_  BUSINESS 


tETTERS 

NOTES 

THESIS 


_  SCHOOL  mOOKS 
I  L  REPORTS 


RLE  WINDOW 


COMMAND  WINDOW 


COMMAND^. 


iyp9  •  Cbmnnnd  «id  pi«w  STTBI.  OT  fypp  EXITIo  OTid  aMfon 


Figure  2.  The  Command  Language  Interface 
Windows . 
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3 .  Commajid  ffjLndotf 


The  Conunand  Window  allows  the  user  to  input  specific 
conunands  to  the  interface.  Each  command  has  a  specific  syntax 
associated  with  it.  If  the  command  is  typed  incorrectly  or 
missing  arguments,  an  error  message  will  appear  below  the 
command  line  indicating  the  reason  for  the  error. 

B.  COMMANDS 

All  commands  availcible  for  the  Command  Language  Interface 
are  identified  below.  Commands  must  be  typed  in  lower  case; 
the  <>  indicate  that  the  user  provides  a  file  name  or 
directory  name.  The  <>  are  not  to  be  typed.  The  path  for  a 
file  or  directory  is  given  using  the  \  and  must  be  included  in 
the  command.  If  a  directory  is  not  specified,  the  interface 
will  assume  the  root  "\"  directory  is  being  referenced. 

1 .  Copy  rii* 

A  file  can  be  copied  from  one  directory  to  another  using 
the  following  command: 

copyfile  <directory\filename>  to  <directory\f ilename> 
with  the  user  providing  the  path  for  the  existing  file  and  new 
file . 

2 .  Croats  Directory 

A  new  directory  can  be  created  using  the  following 
command : 

createdir  <directory\new  directory  name> 
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with  the  user  providing  the  path  and  name  for  the  new 
directory. 

3.  CreatB  File 

A  new  file  can  be  created  using  the  following  command: 
createfile  <directory\new  file  ncune> 
with  the  user  providing  the  path  and  name  for  the  new  file. 

4.  Directory  Tree 

A  directory  tree  of  a  specified  directory  can  be 
displayed  on  the  screen  using  the  following  command: 
dirtree  <directory> 

with  the  user  providing  the  path  of  the  directory  to  be 
displayed. 

5.  Help 

The  help  command  provides  the  user  information  regarding 
the  interface  and  any  command.  At  the  command  line  the  user 
can  type  help  for  general  information  or  the  following  for 
more  specific  information  about  a  command: 
help  <command> 

€.  Listing  Directory  Files 

The  files  for  a  specific  directory  can  be  displayed  using 
the  following  command: 

listfiles  <directory> 

with  the  user  providing  the  path  for  the  directory  to  be 
displayed. 
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7.  Kamova  Diractory 

When  a  directory  does  not  contain  files  nor 
subdirectories,  and  is  no  longer  needed,  it  can  be  deleted 
using  the  following  command: 

removedir  <directory> 

with  the  user  providing  the  path  of  the  directory  to  be 
deleted. 

6 .  Kamova  File 

A  file  can  be  deleted  from  a  directory  using  the 
following  command: 

removefile  <directory\filename> 
with  the  user  providing  the  path  of  the  file  to  be  deleted. 

9.  Rename  a  File 

A  file  can  be  renamed  using  the  following  command: 

renamefile  <directory\filen2uiie>  to  <directory\new 
f ilename> 

with  the  user  providing  the  paths  for  the  old  and  new  file 
ncunes . 

1 0 .  Sort  Files 

The  files  in  the  file  window  can  be  sorted  by  name,  date, 
or  size  using  the  following  command: 

sortfile  <directory>  by  date 
sort file  <directory>  by  size 
sortfile  <directory>  by  neime 

with  the  user  providing  the  path  for  the  directory  to  be 
sorted. 
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V. 


YOUR  TASK 


Your  task  is  to  practice  each  operation  specified  below. 
It  is  important  for  you  to  understand  each  operation,  because 
the  step  by  step  procedures  will  not  be  available  during  the 
actual  experiment.  Use  the  online  help  and  directory  tree  as 
necessary.  For  data  collection  purposes,  it  is  important  that 
you  conduct  the  experiment  without  delay. 
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VI .  PRACTICE 


A.  FILE  OPERATIONS: 

NOTE:  REPEAT  EACH  OPERATION  UNTIL  SUCCESSFULLY  COMPLETED  AND 
YOU  FEEL  COMFORTABLE  ABOUT  THE  OPERATION. 

1.  HELP 

To  obtain  help  for  the  Create  File  conunand,  enter  the 
following  at  the  command  line: 

help  createfile 

2.  CREATE  FILE 

Create  a  file  named  bobcat  in  the  animals  directory; 
createfile  animal s\bobcat 


3.  SORT  FILES 

Sort  the  special  directory  by  size: 
sortfile  special  by  size 


4.  DELETE  FILE 

Delete  a  file  named  presntl  in  the  people  directory; 
removefile  people\presntl 


5.  COPY  FILE 

Copy  the  cat  file  in  the  animals  directory  to  kitty  in 
the  animals  directory; 

copyfile  animals\cat  to  animals\kitty 


6.  RENAME  FILE 

Rename  the  girl  file  in  the  people  directory  to  woman  in 
the  people  directory; 

renamefile  people\girl  to  people\woman 
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B.  DIRECTORY  OPERATIONS: 


1.  CREATE  DIRECTORY 

Create  a  subdirectory  of  animals  called  mammals: 
createdir  animals Xmammals 


2.  TREE 

Display  a  directory  tree  on  the  root  ”\"  directory: 
dirtree 

3.  DELETE  DIRECTORY 

Delete  the  subdirectory  of  animals  called  mammals: 
removedir  animalsXmcunmals 


****  STOP  **** 

***  CALL  THE  EXPERIMENTER  TO  PROCEED  WITH  THE  EXPERIMENT  *** 
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VII.  COMMAND  IAN6UA6E  EXPERIMENT 


YOUR  NAME; 
SMC  NO; 


Complete  the  following  operations  using  the  procedures  you 
have  learned.  Use  the  help  screen  as  needed.  Work  at  a 
normal  pace  and  as  accurately  as  possible. 


1.  Create  a  subdirectory  of  \  called  plots. 


2.  Create  a  file  called  twoplots .  drs  in  the  plots  directory. 


3.  Delete  the  file  called  project.bak  in  the  project 
directory. 


4.  Copy  the  plot.drs  file  in  the  \  directory  to  plot.bak  in 
the  \  directory. 


5.  Rencune  the  file  called  twoplots  .drs  in  the  plots 
directory  to  twoplot .bak. 


***  STOP  *** 

***  CALL  THE  EXPERIMENTER,  TO  PROCEED  WITH  THE  EXPERIMENT  *** 
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VIII. 


COMMAND  LANGUAGE  EXPERIMENT 


Complete  the  following  operations  using  the  procedures  you 
have  learned.  Use  the  help  screen  as  needed.  Work  at  a 
normal  pace  and  as  accurately  as  possible. 


1 .  Copy  the  package  file  in  the  business  directory  to  the 
box  file  in  the  business  directory. 


2.  Ren2une  the  papers  file  in  the  supplies  directory  to 
document  in  the  supplies  directory. 


3.  Create  a  file  called  car  in  the  ground  directory  and  sort 
ground  files  by  file  size. 


4.  Delete  the  planes  directory. 


5.  Find  the  largest  file  of  all  the  directories  and  reneune 
the  file  to  large. fil. 
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IX. 


COMPLETE  THE  FOLLOWING  QUESTIONS 


1.  How  easy  was  this  interface  to  use? 

9) 

very 
easy 


(1  2345678 

not  at 
all  easy 


2 .  How  easy  was  this  interface  to  learn? 


(1  2  3  4  5  6  7 

not  at 
all  easy 


8 


9) 

very 

easy 


3.  To  what  extent  were  the  error  messages  helpful? 


(1  2 


not  at 
all  helpful 


3  4  5  6  7 


8  9) 

very 

helpful 


4. 


How  rapidly  did  you  progress  through  this 


experiment? 


(1  2  3  4  5  6  7 

not  at 
all  rapid 


8 


9) 

very 

rapid 


5.  How  close  do  you  feel  you  were  to  100%  accuracy? 
% _  (consider  all  errors) 

Estimate  the  nvimber  of  errors  that  occurred 


6.  At  ciny  time  during  the  experiment,  did  the  interface 
appear  so  difficult  that  you  were  ready  to  edjandon  the 
experiment? 

Yes  No 


If  so,  at  what  point? 
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X. 


PLEASE  COMPLETE  THE  FOLLOWING  QUESTIONS 


1 ,  Prior  to  this  experiment  what  was  your  experience  with 
computers? 

(1  2345678  9) 

no  very 

experience  experienced 

2.  If  you  have  an  experience  level  of  2  or  greater  from  the 
previous  question,  what  type  of  operating  system  have  you 
obtained  the  majority  of  your  experience? 

_  DOS  (Disk  Operating  System) 

_  UNIX 

_  Apple  /  Macintosh 

_  VAX 

_  Other  (Please  specify)  _ 


3 .  Complete  the  following  using  the  knowledge  for  the 

operating  system (s)  specified  above.  Please  specify  the 
command  if  applicable. 


a.  How  do  you  change  directories,  i.e.,  to  the 

"wp"  directory? 


b.  How  do  you  list  the  files  in  the  WP  directory? 


c.  How  do  you  erase  the  "Miscellaneous"  file  from 

the  WP  directory? 


d.  How  do  you  find  all  batch  files  in  the  root 

directory? 
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How  do  you  copy  all  batch  files  to  a  floppy 
disk? 


e . 


f .  How  do  you  rename  the  autoexec  batch  file  to  a 

backup  file? 


g.  How  do  you  create  a  new  autoexec  batch  file? 


h.  How  do  you  change  a  file  to  "read  only"? 


i .  How  do  you  convert  an  .  exe  file  to  a  .  com 

file? 


4.  What  is  your  typing  experience: 

(1  2345678  9) 

no  very 

experience  experienced 


Please  complete  the  following: 

Age  _ 

Sex  Male  Female 

Undergraduate  degree  _ 

NPS  Curricultim  (if  student)  _ 

Years  of  computer  experience  _ 
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APPENDIX  C 


SUMMARY  OF  INTERFACE  COMMANDS 


DMI  Steps  to 


Commzund 

CLI  tvped  Coinm2unds 

Execute  Coomemd 

Copy  File 

copyfile  <directory/ 

1. 

Select  help  icon. 

filencime>  to 
<directory/f ilename> 

2. 

Frcune  Help  window. 

Create  File 

createfile 

1. 

Select  directory 

<directory/f ilename> 

2. 

icon. 

Select  new  name  of 
file. 

3. 

Select  create  file 
icon . 

4. 

Select  accept  from 
Prompter  window. 

Create  Sijb- 

createdir 

1. 

Select  directory  to 

directory 

<directory/new 

contain  new  sub¬ 

subdirect ory> 

2. 

directory. 

Select  new  name  for 
directory . 

3. 

Select  create 

directory  icon. 

4. 

Select  accept  from 
Prompter  window. 

Delete 

removedir 

1. 

Select  directory  to 

Directory 

<directory> 

2. 

be  deleted. 

Select  delete 

directory  icon . 

3. 

Select  accept  from 
Prompter  window. 

97 


APPENDIX  C  (continued) 


Delete  File 

removefile 

1. 

Select  directory 

<directory/ f  ileneime> 

2. 

containing  file  to 
be  deleted. 

Select  file  to  be 
removed . 

3. 

Select  delete  file 
icon . 

4. 

Select  accept  from 
Prompter  window. 

Directory 

dirtree 

1. 

Select  directory 

Tree 

tree  icon. 

2. 

Frame  Directory 

Tree  window. 

Help 

help 

1. 

Select  help  icon . 

2. 

Freune  Help  window. 

Help  on  a 

help  <command> 

1. 

Select  help  icon. 

command 

2. 

Fraune  Help  window. 

3. 

Select  command. 

List  Files 

listfiles 

1. 

Select  directory  to 

in  a 

directory 

<directory> 

list  files. 

Sort  File  by 

sortfile  <directory> 

1. 

Select  directory  to 

method 

by  <method> 

be  sorted. 

(name,  date, 

2. 

Select  menu  for 

or  size) 

3. 

Sort  window. 

Select  method  for 

files  to  be  sorted. 
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APPENDIX  D 


DIRECT  MANIPULATION  INTERFACE 


YOUR  NAME ;  _ 

SMC  NO :  _ 

I .  INTRODUCTION 

The  exercise  you  are  about  to  participate  in  involves 
operating  and  evaluating  a  recently-developed  computer  file 
management  system.  You  will  be  asked  to  read  a  short 
description  of  file  management,  followed  by  instructions  for 
each  file  management  operation.  You  will  then  practice  each 
operation  until  you  can  perform  the  operation  successfully. 
Upon  completing  all  the  operations  successfully,  you  will  do 
a  series  of  tasks  that  involve  using  the  operations  you  have 
learned. 


PRIVACY  ACT 

The  information  accompanying  this  experiment  will  be  used  for 
data  collection  and  correlation  purposes  only.  Information 
provided  is  voluntary. 
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II.  QUESTIOMIUIIRE 


INSTRUCTIONS; 

Please  place  a  T(true)  or  F  (false)  next  to  each  of  the 

following  statements  as  you  feel  it  best  applies  to  you. 

_  1.  I  enjoy  doing  work  that  requires  the  use  of  words. 

_  2 .  My  daydreams  are  sometimes  so  vivid  I  feel  as  though 

I  actually  experience  the  scene. 

_  3.  I  enjoy  learning  new  words. 

_  4.  I  can  easily  think  of  synonyms  for  words. 

_  5.  My  powers  of  imagination  are  higher  than  average. 

_  6.  I  seldom  dream. 

_  7.  I  read  rather  slowly. 

_  8 .  I  cannot  generate  a  mental  picture  of  a  friend' s 

face  when  I  close  my  eyes. 

_  9.  I  don't  believe  that  anyone  can  think  in  terms  of 

mental  pictures . 

_  10.  I  prefer  to  read  instructions  about  how  to  do 

something  rather  than  have  someone  show  me. 

_  11.  My  drezuns  are  sometimes  vivid. 

_  12.  I  have  better  than  average  fluency  in  using  words. 

_  13.  My  daydreams  are  rather  indistinct  and  hazy. 

_  14.  I  spend  very  little  time  attempting  to  increase  my 

vocad^ulary . 

_  15.  My  thinking  often  consists  of  mental  pictures  or 

images . 
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III.  riI.E  MAIU^GEMENT  SYSTEM 


A.  OPERATING  SYSTEM 

An  operating  system  is  the  software  prograim  that  makes 
the  hardware  useable.  The  operating  system  can  accomplish 
many  functions  such  as  communicating  between  the  user  and  the 
computer  (known  as  the  user  interface) ,  sharing  hardware  among 
users,  allowing  users  to  share  data  eimong  themselves,  and  many 
other  functions. 

An  operating  system' s  primary  duty  is  to  manage  various 
files.  Before  we  go  into  the  details  of  files,  it  is 
important  to  understand  the  structure  and  organization  of 
files . 

B.  DIRECTORIES  AND  FILES 

A  software  program  usually  consists  of  several  files. 
These  files  work  together  to  produce  the  progreun  that  the  user 
sees  and  interacts  with  on  the  screen.  A  directory  contains 
all  of  the  files  used  for  a  given  program.  For  instance,  all 
the  files  that  operate  the  popular  word  processing  program, 
WordPerfect  5.1,  might  be  located  in  a  directory  called  WP51. 
It  is  also  possible  (and  highly  recommended)  to  have 
subdirectories  within  a  directory  to  segregate  your  files 
further.  For  instance,  in  the  WP51  directory  you  might  have 
a  siibdirectory  titled  WORK  for  all  the  files  relating  to  your 
work  and  one  titled  THESIS  for  all  the  files  relating  to  your 
thesis . 
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Figure  1  shows  the  relationship  of  this  WP51  directory  to 
its  subdirectories  and  files,  and  also  its  relationship  with 
the  top-level  Root  directory,  often  represented  by  a  slash 
(\)  .  Two  other  directories  at  the  same  level  as  WP51  (here 
called  DOS  and  HG)  also  are  shown,  along  with  their  files. 


Figure  1.  Relationships  of  the  WP51  Directory 
with  other  Directories  and  Files . 


It  is  often  necessary  to  copy  or  move  a  file  from  one 
directory  to  another.  The  operating  system  must  provide 
methods  to  move  these  files.  For  exeunple,  suppose  you  wrote 
a  paper  for  a  National  Security  class  titled  The  Middle  East 
and  stored  this  file  in  the  WORK  directory  under  WP51 .  Later 
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in  the  year  you  decide  to  use  this  paper  in  your  thesis  and 
need  to  transfer  the  file  to  the  THESIS  subdirectory.  Some 
form  of  move  or  copy  command  would  allow  you  to  transfer  this 
file.  Additionally,  you  may  want  to  change  the  file  name  to 
Chapter  II.  Again  the  operating  system  interface  must  provide 
a  means  of  doing  so. 

As  mentioned  earlier,  directories  contain  related  files. 
The  operating  system  interface  also  must  provide  a  means  to 
manage  directories.  That  is,  commands  such  as  create 
directory  and  delete  directory  are  needed. 

IV.  OPERATING  SYSTEM  INTERFACE 


The  experimental  operating  system  interface  you  will  be 
working  with  is  called  a  Direct  Manipulation  Interface.  It 
uses  the  mouse  device  to  "click"  on  to  various  icons, 
directory  neunes,  or  file  names  on  the  screen.  An  icon  is  a 
graphical  representation  of  an  object  or  an  operation.  Once 
activated,  the  icon  carries  out  a  specific  function  or 
operation,  such  as  copying  a  file  from  one  directory  to 
another . 

A.  MOUSE 

The  mouse  (Figure  2)  is  the  only  input  device  you  will  be 
using  for  this  experiment.  The  keyboard  will  only  be 
operational  when  entering  your  name  and  SMC  at  the  beginning 
of  the  experiment. 
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Hold  the  mouse  in  the  right  hand  (if  right  handed,  left 
hand  if  left  handed)  so  that  the  cord  and  buttons  are  at  the 
top.  Place  your  index  and  middle  fingers  lightly  over  the 
mouse  buttons .  Gently  guide  the  movement  of  the  mouse  with 
the  hand. 

Normally,  the  mouse  is  represented  as  an  arrow,  or 
cursor,  which  moves  on  the  screen  as  you  move  the  mouse.  When 
the  system  is  performing  an  operation  that  takes  longer  than 
one  second,  the  cursor  will  appear  as  an  hour  glass  to 
indicate  that  the  operation  will  take  time.  The  cursor  is  not 
functional  in  the  hour  glass  mode. 

Gently  press  or  "click"  the  left  button  to  select  the 
item  on  the  screen  superimposed  by  the  arrow  or  cursor.  Click 
the  right  button  to  call  up  a  menu  that  describes  operations 
you  can  do  in  a  given  window.  Each  window  has  a  menu  assigned 
to  it .  Most  of  the  window  menus  are  not  operational . 
However,  the  help,  sort,  tree,  and  error  windows  do  have 
operational  menus . 
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Figure  2 .  Mouse  Control  Device 


B .  WINDOWS 

The  Direct  Manipulation  Interface  consists  of  five 
windows  (Figure  3) .  These  are  (1)  Directory  Window,  (2)  File 
Window,  (3)  File  Sort  Window,  (4)  New  Name  Window,  and  (5) 
Icon  Window.  Each  window  has  a  specific  function  and 
interacts  with  the  other  windows  by  use  of  mouse  operations . 
Additionally,  the  Help  and  Tree  windows  will  pop  up  onto  the 
screen  when  the  icon  that  represents  one  of  them  is  selected. 

All  windows  have  similar  characteristics .  The  Top  Pane 
is  the  main  window  that  includes  all  other  windows  and 
encompasses  the  entire  screen.  The  label  of  the  top  pane 
contains  the  ncune  of  the  interface  or  the  naime  of  a  selected 
directory.  The  Directory,  File,  and  New  Name  windows  all 
operate  in  a  similar  manner  when  the  user  selects  an  item. 
The  selected  item  will  appear  highlighted.  Due  to  the  limited 
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size  of  the  windows/  not  all  fileS/  directories,  or  new  names 
may  fit  in  the  window  at  one  time.  The  window  operations 
provide  the  ability  to  scroll  the  window.  Scroll  a  window  by 
pressing  and  holding  the  right  mouse  button  (cursor  changes  to 
a  four  directional  arrow)  in  the  window  to  be  scrolled.  Move 
the  cursor  out  of  the  window  in  the  direction  of  the 
additional  names .  The  scroll  bar  to  the  right  of  the  window 
shows  the  status  of  the  scrolling  with  respect  to  the  total 
list.  The  scroll  bar  appears  only  during  the  scrolling 
operation. 

1 .  Directory  ffindow 

The  Directory  window  contains  a  list  of  all  the 
directories  on  the  disk  in  alphcibetical  order.  The 
directories  are  indented  to  reflect  their  hierarchical  or  tree 
structure.  For  example,  each  svibdirectory  will  be  indented 
one  space  from  the  parent  directory. 

2 .  File  Nindoff 

The  name  of  the  selected  directory  appears  in  reverse 
video  (black  background,  white  lettering)  in  the  Directory 
window  and  the  names  of  all  files  contained  in  the  directory 
are  displayed  in  the  File  window.  Files  listed  in  the  File 
window  are  in  alphcibetical  order.  All  operations  on  files 
will  be  carried  out  using  the  File  window. 
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DIRECTOHY 

WINDOW 


FILE 

WINDOW 


RLE  SORT 
WINDOW 


ICON 

WINDOW 


NEW 

NAME 

WINDOW 


Figure  3 .  The  Direct  Manipulation  Interface  Top  Pane 
and  Component  Windows 


3.  Fil0  Sort  WxndOH 

The  File  Sort  window  contains  the  names  of  all  the  files 
listed  in  the  File  window,  plus  additional  information  about 
these  files.  The  File  Sort  window  has  two  parts,  a  label  and 
a  text  portion.  The  label,  i.e..  Files  Sorted  by  Name, 
contains  a  menu  which  allows  the  files  to  be  sorted  by  name, 
date,  or  size.  Items  can  be  selected  from  this  menu  by 
clicking  the  right  mouse  button  when  the  arrow  is  over  the 
label  and  selecting  with  the  left  mouse  button  the  desired 
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sorting  method.  The  File  Sort  window  will  then  contain  the 
files  of  the  selected  directory  sorted  by  the  specified  method 
(see  Figure  4) . 


Files  sorted  by  size 


etter.bak 
hap.1 

chap.2 


size 


233  90-10-17  20: 
10034  90-07-20  18: 


name 


date 


22456  90-11-02  12:34:22 


Figure  4 .  Exaa^le  of  File  Sort  Window,  with  File 
Names  Sorted  by  Size. 


4.  New  Name  ffindOH 

The  New  Naime  window  contains  a  list  of  all  the  names 
needed  for  new  files,  renamed  files,  and  directories.  The  new 
name  must  be  selected  before  an  icon  is  selected  to  complete 
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an  operation  on  a  file,  if  that  operation  involves  nciming  the 
file.  The  system  removes  the  selected  new  neime  after  it  has 
been  used. 


5.  Xcon  Windotf 

The  Icon  window  is  divided  into  three  sections:  File 
Icons,  Directory  Icons,  and  Other  Icons.  Using  this  window, 
files  and  directories  can  be  created,  copied,  renamed,  and 
deleted,  as  discussed  below. 

a.  Create  File  Icon 

The  Create  File  icon  creates  a  new  file  in  the  selected 
directory  using  the  naime  selected  in  the  New  Ncune  window. 

b.  Copy  File  Icon 

The  Copy  File  icon  copies  a  selected  file  to  the  selected 
directory  using  the  selected  name  in  the  New  Ncuhe  window. 

c.  Rename  File  Icon 

The  Rename  File  icon  reneunes  a  selected  file  to  the 
selected  ncime  in  the  New  Name  window. 

d.  Delete  File  Icon 

The  Delete  File  icon  deletes  the  selected  file  from  the 
selected  directory. 

e.  Create  Directory  Icon 

The  Create  Directory  icon  creates  a  new  subdirectory 
under  the  selected  directory  using  the  selected  name  in  the 
New  Name  window. 
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f.  Directory  Tree 


The  Directory  Tree  icon  displays  a  graphical  depiction  of 
the  directories  on  the  drive. 

g.  Delete  Directory 

The  Delete  Directory  icon  deletes  the  selected  directory 
from  the  disk.  The  selected  directory  cannot  contain  files 
nor  subdirectories . 

h .  Help 

The  Help  icon  displays  the  Help  window  described  below. 

6.  Prompter  Window 

When  you  are  performing  a  file  or  directory  operation  a 
"Prompter  window"  will  appear.  This  window  allows  you  to 
confirm  or  cancel  the  operation.  When  this  window  appears, 
click  the  right  mouse  button  while  the  arrow  is  in  the  white 
portion  of  the  window  (suggested  file  or  directory  neune)  to 
call  up  the  menu.  Then  select  the  "accept"  or  "cancel"  option 
with  the  left  mouse  button.  A  Prompter  window  also  will 
appear  when  you  attempt  to  conduct  an  operation  without  having 
specified  all  the  necessary  information.  The  needed 

information  will  appear  in  the  white  portion  of  the  window. 
Remove  the  Prompter  window  by  selecting  "cancel"  from  the 
prompter  menu. 

7.  Help  Window 

The  Help  window  provides  information  on  window 
operations,  icons,  and  window  locations.  The  Help  window  can 
be  displayed  by  selecting  the  Help  icon.  Hold  down  the  left 
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mouse  button  until  a  prompt  appears  for  the  left  corner  of  the 
Help  window.  Move  the  pop-up  window  corner  to  the  upper  left 
corner  of  the  screen  and  release  the  mouse  button.  The  lower 
right  corner  of  the  window  will  appear  and  can  be  repositioned 
with  the  mouse.  Click  the  left  mouse  button  when  the  size  of 
the  window  is  at  least  5  inches  sqpiare. 

The  help  commands  appear  in  alphcibetical  order.  When  a 
command  is  sellected,  a  description  of  the  command  will  be 
provided  in  the  right  pane  (text  pane)  of  the  window.  The 
command  list  and  text  pane  can  be  scrolled  in  the  manner 
discussed  earlier:  press  the  right  mouse  button  and  drag  the 
cursor  out  of  the  pane  in  the  direction  of  the  unseen  text . 

6 .  Error  WlndoHS 

Error  windows  can  appear  either  as  a  Prompter  window  or 
as  a  Pop-up  window.  A  Prompter  window  will  be  a  small  window 
with  a  short  message.  Selecting  an  icon  without  all  the 
necessary  information  specified  will  cause  it  to  appear.  It 
can  be  removed  by  (1)  selecting  the  right  mouse  button  when 
the  cursor  is  located  in  the  white  portion  of  the  prompter 
(area  of  short  message)  to  obtain  the  menu  options  and  then 
(2)  selecting  the  "cancel"  option. 

If  you  attempt  an  operation  that  the  operating  system 
does  not  allow,  an  Error  Pop-up  window  will  appear  in  the 
middle  of  the  screen.  The  label,  located  at  the  top,  will 
contain  the  error  message.  The  remaining  text  portion  of  the 
window  may  be  confusing  and  it  is  not  necessary  for  you  to 
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understand  it.  To  remove  the  window,  use  the  mouse's  left 
button  and  cursor  to  select  a  point  outside  the  window,  or 
select  the  menu  with  the  right  mouse  button  in  the  leJsel  and 
then  the  "close"  option  with  the  left  mouse  button. 

9.  Directory  Tram 

A  Directory  Tree  is  helpful  for  seeing  the  "whole 
picture"  of  directories  and  subdirectories.  As  in  the 
Directory  window,  a  subdirectory  will  branch  off  from  its 
parent  directory.  The  Directory  Tree  window  can  be  displayed 
by  selecting  the  Tree  icon.  Hold  down  the  left  mouse  button 
until  a  prompt  appears  at  the  left  corner  of  the  Tree  window. 
Move  the  Pop-up  window  corner  to  the  upper  left  corner  of  the 
screen  and  release  the  mouse  button.  The  lower  right  corner 
of  the  window  will  appear  and  cam  be  repositioned  with  the 
mouse .  Click  the  left  mouse  button  when  the  size  of  the 
window  is  approximately  5  to  6  inches  square . 
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V. 


YOUR  TASK 


Your  task  is  to  practice  each  operation  specified  below. 
It  is  important  for  you  to  understand  each  operation,  because 
the  step  by  step  procedures  will  not  be  available  during  the 
actual  experiment.  Use  the  online  help  and  Directory  Tree  as 
necessary.  For  data  collection  purposes,  it  is  important  that 
you  conduct  the  experiment  without  delay. 
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VI .  PRACTICE 


A.  FILE  OPERATIONS: 


NOTE :  REPEAT  EACH  OPERATION  UNTIL  IT  IS  SUCCESSFULLY  COMPLETED 
AND  YOU  FEEL  COMFORTABLE  ABOUT  THE  OPERATION. 


1.  HELP 
a . 


b. 


c. 


d. 

e . 


f . 


SCREEN 

Select  the  Help  icon,  holding  the  left  mouse  button 
dovm. 

Move  the  cursor  to  the  upper  left  corner  of  the  screen 
and  release  the  mouse  button. 

Move  the  cursor  to  the  lower  right  portion  of  the 
screen  and  press  the  left  mouse  button. 

Select  the  Create  File  item  for  information. 

To  close  Help  window,  press  the  right  mouse  button  on 
the  window  label. 

Select  close. 


2.  CREATE  FILE 

a.  Select  the  animals  directory. 

b.  Select  the  bobcat  name  from  the  New  Neime  window. 

c .  Select  the  Create  File  icon . 

d.  Select  the  Prompter  menu  by  pressing  right  mouse 
button  in  the  white  portion  of  the  Prompter  window. 

e.  Select  "accept"  from  the  Prompter  window  menu. 


3. 


SORT  FILES 

a.  Select  the  special  directory  from  the  Directory 
window. 

b.  Select  the  menu  for  the  Sort  window  by  pressing  the 
right  mouse  button  over  the  label  for  the  Sort  window. 

c.  Select  Size  order  in  the  Pop-up  menu. 


4 .  DELETE  FILE 

a.  Select  the  people  directory  from  the  Directory  window. 

b.  Select  the  presntl  file  from  the  File  window. 

c.  Select  the  Delete  File  icon. 

d.  Select  the  Prompter  menu  by  pressing  right  mouse 
button  in  the  white  portion  of  the  Prompter  window. 

e.  Select  "accept"  from  the  Prompter  window  menu. 


5. 


COPY  FILE 

a.  Select  the  animals  directory  from  the  Directory 
window . 

b.  Select  the  cat  file  from  the  File  window. 

c.  Select  the  kitty  naune  from  the  New  Name  window. 

d.  Select  the  Copy  icon. 

e.  Select  the  Prompter  menu  by  pressing  right  mouse 
button  in  the  white  portion  of  the  Prompter  window. 

f .  Select  "accept"  from  the  Prompter  window  menu. 
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6.  RENAME  FILE 

a.  Select  the  people  directory  from  the  Directory  window. 

b.  Select  the  girl  file  from  the  File  window. 

c.  Select  the  woman  name  from  the  New  Name  window. 

d.  Select  the  Rename  File  icon. 

e.  Select  the  Prompter  menu  by  pressing  right  mouse 
button  in  the  white  portion  of  the  Prompter  window. 

f.  Select  "accept"  from  the  Prompter  window  menu. 


B.  DIRECTORY  OPERATIONS: 


1.  CREATE  DIRECTORY 

a.  Select  the  animals  directory  from  the  Directory 
window . 

b.  Select  the  New  Neune  mammals  from  the  New  Name 
window . 

c.  Select  the  Create  Directory  icon. 

d.  Select  the  Prompter  menu  by  pressing  right  mouse 
button  in  the  white  portion  of  the  Prompter  window. 

e.  Select  "accept"  from  the  Prompter  window  menu. 


2 .  TREE 

a.  Select  the  Tree  icon,  hold  the  left  mouse  button  down 
and  move  the  cursor  to  the  upper  left  corner  of  the 
screen  and  release . 

b.  When  the  lower  right  corner  of  the  window  appears, 
position  it  to  the  lower  right  portion  of  the  screen 
and  click  the  left  mouse  button. 

c.  To  close  the  Directory  Tree,  press  the  right  mouse 
button  on  the  window  label. 

d.  Select  close. 


3.  DELETE  DIRECTORY 

b.  Select  the  mammals  directory  from  the  Directory 
window  (NOTE:  there  must  be  no  files  present  in  the 
directory  to  be  deleted) . 

c.  Select  the  Delete  Directory  icon. 

d.  Select  the  Prompter  menu  by  pressing  right  mouse 
button  in  the  white  portion  of  the  Prompter  window. 

e.  Select  "accept"  from  the  Prompter  window  menu. 


****  STOP  **** 


***  CALL  THE  EXPERIMENTER,  TO  PROCEED  WITH  THE  EXPERIMENT  *** 
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VII.  DIRECT  MANIPULATION  EXPERIMENT 


YOUR  NAME: 
SMC  NO; 


Complete  the  following  operations  using  the  procedures  you 
have  learned.  Use  the  help  screen  as  needed.  Work  at  a 
normal  pace  and  as  accurately  as  possible. 


1.  Create  a  sxjbdirectory  of  \  called  plots. 


2.  Create  a  file  called  twoplots .drs  in  the  plots  directory. 


3.  Delete  the  file  called  project.bak  in  the  project 
directory. 


4.  Copy  the  plot  .drs  file  in  the  \  directory  to  plot  .bak  in 
the  \  directory. 


5.  Rename  the  file  called  twoplots .drs  in  the  plots 
directory  to  twoplot .bak. 


***  STOP  *** 


***  CALL  THE  EXPERIMENTER,  TO  PROCEED  WITH  THE  EXPERIMENT  *** 
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VTll. 


DIRECT  MANIPUIJITION  EXPERIMENT 


Complete  the  following  operations  using  the  procedures  you 
have  learned.  Use  the  help  screen  as  needed.  Work  at  a 
normal  pace  and  as  accurately  as  possible. 


1 .  Copy  the  package  file  in  the  business  directory  to  the 
box  file  in  the  business  directory. 


2.  Rename  the  papers  file  in  the  supplies  directory  to 
document  in  the  supplies  directory. 


3.  Create  a  file  called  car  in  the  ground  directory  and  sort 
ground  files  by  file  size. 


4.  Delete  the  planes  directory. 


5 .  Find  the  largest  file  of  all  the  directories  and  rename 

the  file  to  large. f 11. 
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IX.  COMPLETE  THE  FOLLOWING  QUESTIONS 

1.  How  easy  was  this  interface  to  use? 

(1  2  3  4  5  6  7 

not  at 
all  easy 


8  9) 

very 
easy 


2. 


How  easy  was  this  interface  to  learn? 


(1  2  3  4  5  6  7 

not  at 
all  easy 


8  9) 

very 
easy 


3.  To  what  extent  were  the  error  messages  helpful? 


(1  2 
not  at 
all  helpful 


3  4  5  6  7 


8  9) 

very 
helpful 


4. 


How  rapidly  did  you  progress  through  this 


experiment? 


(1  2  3  4  5  6  7 

not  at 
all  rapid 


8  9) 

very 
rapid 


5. 


How  close  do  you  feel  you  were  to  100%  accuracy? 
% _  (consider  all  errors) 


Estimate  the  number  of  errors  that  occurred 


6.  At  auiy  time  during  the  experiment,  did  the  interface 
appear  so  difficult  that  you  were  ready  to  cO^andon  the 
experiment? 

Yes  No 


If  so,  at  what  point? 
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X.  PLEASE  COMPLETE  THE  FOLLOWING  QUESTIONS 

1.  Prior  to  this  experiment  what  was  your  experience  with 
computers? 

(1  2345678  9) 

no  very 

experience  experienced 

2.  If  you  have  an  experience  level  of  2  or  greater  from  the 
previous  question,  what  type  of  operating  system  have  you 
obtained  the  majority  of  your  experience? 

_  DOS  (Disk  Operating  System) 

_  UNIX 

_  Apple  /  Macintosh 

_  VAX 

_  Other  (Please  specify)  _ 


3,  Complete  the  following  using  the  knowledge  for  the 
operating  system  (s)  specified  2dDove.  Please  specify  the 
command  if  appliccible. 


a.  How  do  you  change  directories,  i.e.,  to  the 

"wp"  directory? 


b.  How  do  you  list  the  files  in  the  WP  directory? 


c.  How  do  you  erase  the  "Miscellaneous"  file  from 

the  WP  directory? 


d.  How  do  you  find  all  batch  files  in  the  root 

directory? 
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e.  How  do  you  copy  all  batch  files  to  a  floppy 

disk? 


f .  How  do  you  rename  the  autoexec  batch  file  to  a 

backup  file? 


g.  How  do  you  create  a  new  autoexec  batch  file? 


h.  How  do  you  change  a  file  to  "read  only"? 


i.  How  do  you  convert  an  .exe  file  to  a  .com 

file? 


4.  What  is  your  experience  with  using  a  mouse: 

(1  2345678  9) 

no  very 

experience  experienced 

Please  complete  the  following: 

Age  _ 

Sex  Male  Female 

Undergraduate  degree  _ 

NPS  Curriculxim  (if  student)  _ 

Years  of  computer  experience  _ 
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APPENDIX  E 


EXAMPLE  OF  CLI  USER  LOG 


Smith/  John 
1000 

1-24-1991 

CLI 


simple 

15:31:19 

15:32:15 

15:33:10 

15:33:45 

15:33: 56 

15:34:58 

15:36:13 

15:36:28 

15:37:17 

15:38:14 

15:39:20 

15:39:32 

15:39:41 

15:41:43 

15:42:07 

15:43:26 

15:44:22 

15:45:50 

15:46:23 

15:47:57 

15:48:36 

15:48:49 

15:49:17 

15:49:59 


DIRC  createdir  plots 
FLCR  createfile  twoplots.drs 
ERRS  deletefile  project.bak 
ERRS  delfile  project.bak 
HELP  help 

RMF3  removefile  project.bak 
HELP  help 
HELP  help 

HELP  help  removefile 
FILR  removefile  pro ject\pro ject .bak 
FILC  copyfile  plot.drs  to  plot. bak 
ERRS  elp 
HELP  help 

RNFl  renamefile  poots\twoplots.drs 
toplots\twoplot .bak 
HELP  help  renamefile 

RNF4  renamefile  plotsXtwoplots . drs  to 
plots \twoplot .bak 
HELP  help  renamefile 

RNF4  renamefile  plotsXtwoplots . drs  to 
plotsXtwoplot .bak 
DRTS  dirtree 

RNF4  renamefile  plotsXtwoplots . drs  to 
plotsXtwoplot . bak 
ERRS  listfile 
HELP  help 

LSFD  listfiles  plots 
LSFD  listfiles  plots 
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APPENDIX  F 


EXAMPLE  OF  DMI  USER  LOG 


Doe,  John 
2000 

1-25-1991 

DMI 

simple 

10:52:48 

SDN 

b: 

10:54:18 

SDN 

b:  \ 

10:54:25 

SNN 

plots 

10:54:40 

SDN 

b: 

10:54:40 

SDN 

b:\plots 

10:54:40 

CDS 

Create  directory  b:\plots 

10:55:11 

SNN 

twoplots . drs 

10:55:20 

CFS 

Create  New  File 
b:  \plots\twoplots .drs 

10:55:22 

SDN 

b:\plots 

10:55:29 

SDN 

b: \pro ject 

10:55:36 

SFN 

pro ject .bak 

10:55:45 

DFS 

Delete  file  \pro ject \pro ject .bak 

10:55:47 

SDN 

b:\project 

10:56:16 

HLP 

Help  window  displayed 

10:56:24 

HLP 

Help  window  displayed 

10:57:03 

SDN 

b:\ 

10:57:34 

SFN 

plot .drs 

10:58:19 

PF2 

ERROR  copy  file  without  select edName 

10:58:30 

PF2 

ERROR  copy  file  without  select edNcune 

10:58:37 

SNN 

plot .bak 

10:59:03 

SNN 

plot .bak 

10:59:05 

SNN 

plot .bak 

10:59:20 

WBW 

WALKBACK  window  generated:  message 
not  understood:  asLowerCase 

10:59:58 

SDN 

b:\ 

10:59:59 

PFS 

Copy  file  b:  \plot .  drs  to  b:  \plot  .bak 

11:00:30 

PF2 

ERROR  copy  file  without  select edNaune 

11:00:31 

HLP 

Help  window  displayed 

11:00:35 

HLP 

Help  window  displayed 

11:00:43 

SHP 

Copy  File 

11:01:25 

SDN 

b: \plots 

11:01:39 

SFN 

twoplots . drs 

11:01:43 

SNN 

twoplot .bak 

11:01:52 

RFS 

Renaune  file  b:\plots\twoplots.drs 
to  b:\plots\twoplot.bak 
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APPENDIX  6 


CODES  AND  MESSAGES  FOR  CLI 

CODE 

MESSAGE 

CRDl 

Error  in  syntax  for  CREATEDIR.  Type  HELP  CREATEDIR  for  correct 

CRD2 

syntax 

Directory  name  is  too  long:  please  specify  another  name^  8 
characters  or  less 

CRD3 
CRD  4 
DIRC 

This  directory  already  exists:  please  specify  another  naime 

A  file  by  that  name  already  exists:  please  provide  another  name 
Directory  created 

RMDl 

Error  in  syntax  for  REMOVEDIR.  Type  HELP  REMOVEDIR  for  correct 

RMD2 

syntax 

Directory  name  is  too  long:  please  specify  another  name,  8 
characters  or  less 

RMD3 

RMD4 

The  directory  specified  does  not  exist:  please  provide  another  name 
The  name  specified  exists  as  a  file:  you  need  to  provide  a 
directory  name 

DIRR 

Directory  removed 

CPFl 

Error  in  syntax  for  COPYFILE.  Type  HELP  COPYFILE  for  correct 

CPF2 

syntax 

File  name  is  too  long:  please  specify  another  name,  8  characters 
or  less 

CPF3 

CPF4 

FILC 

The  target  file  already  exists:  please  specify  another  name 

The  source  file  does  not  exist:  please  specify  another  name 

File  copied 

CRFl 

Error  in  syntax  for  CREATEFILE.  Type  HELP  CREATEFILE  for  correct 

CRF2 

CRF3 

CRF4 

FLCR 

syntax 

File  name  is  too  long:  please  specify  another  name 

The  file  already  exists:  please  specify  another  name 

The  directory  name  is  not  valid:  please  specify  another  name 

File  created 

RNFl 

Error  in  syntax  for  RENAMEFILE .  Type  HELP  RENAMEFILE  for  correct 

RNF2 

syntax 

File  name  is  too  long:  please  specify  another  name,  8  characters 
or  less 

RNF3 

RNF4 

FLRN 

The  target  file  already  exists:  please  specify  another  name 

The  source  file  does  not  exist:  please  specify  another  name 

File  renamed 

APPENDIX  G  (continued) 

RMFl 

Error  in  syntax  for  REMOVEFILE.  Type  HELP  REMOVEFILE  for  correct 

RMF2 

syntax 

File  name  is  too  long:  please  specify  another  name,  8  characters 
or  less 

RMF3 

The  file  does  not  exist:  please  specify  another  name 
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RMF4  The  directory  name  is  not  valid;  please  specify  another 
name 

FILR  File  removed 

LSFl  Error  in  syntax  for  LISTFILES.  Type  HELP  LISTFILES  for 
correct  syntax 

LSF2  Directory  name  is  too  long:  please  specify  another  name^ 
8  characters  or  less 

LSF3  The  directory  specified  does  not  exist;  please  provide 
another  name 

LSFD  List  of  files  in  directory  displayed 

SRFl  Error  in  syntax  for  SORTFILE.  Type  HELP  SORTFILE  for 
correct  syntax 

SRF2  Directory  name  is  too  long:  please  specify  another  name^ 
8  characters  or  less 

SRF3  The  directory  specified  does  not  exist;  please  provide 
another  name 

SRFD  Sorted  list  of  files  in  directory  displayed 

DRTl  Error  in  syntax  for  DIRTREE.  Type  HELP  DIRTREE  for 
correct  syntax 

DRTS  Directory  tree  displayed 
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APPENDIX  H 


CODE 

GDI 

CD2 

CDS 

DDl 

DDS 

PFl 

PF2 

PFS 

CFl 

CF2 

CFS 

RFl 

RF2 

RFS 

DFl 

DFS 

WBW 


SDN 

SNN 

SFN 

SHP 

HLP 

SPS 

DTS 


CODES  AND  MESSAGES  FOR  DMI 


MESSAGE 

ERROR  create  directory  without  selected  directory 
ERROR  create  directory  without  selected  name 
Create  directory  successful 

ERROR  delete  directory  without  selected  directory 
Delete  directory  successful 

ERROR  copy  file  without  selected  file 
ERROR  copy  file  without  selected  name 
Copy  file  successful 

ERROR  create  file  without  selected  directory 
ERROR  create  file  without  selected  name 
Create  file  successful 

ERROR  rename  file  without  selected  file 
ERROR  rename  file  without  selected  ncime 
Reneune  file  successful 

ERROR  delete  file  without  selected  file 
Delete  file  successful 

ERROR  SmallTalk  WalkBack  Window  generated  due  to  DOS 
error 

Select  directory  neime 
Select  new  neime 
Select  file  name 
Select  help 
Select  help  object 
Sort  files  successful 
Directory  tree  displayed 
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